Jul 14 00:57:28.949300 ip-10-0-131-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 00:57:28.949316 ip-10-0-131-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 00:57:28.949326 ip-10-0-131-57 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 00:57:28.949560 ip-10-0-131-57 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 00:57:38.689467 ip-10-0-131-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 00:57:38.689483 ip-10-0-131-57 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c411d1a0c8b74fa5a324386196deea36 -- Jul 14 00:59:12.000213 ip-10-0-131-57 systemd[1]: Starting Kubernetes Kubelet... Jul 14 00:59:12.440186 ip-10-0-131-57 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 00:59:12.440186 ip-10-0-131-57 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 00:59:12.440186 ip-10-0-131-57 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 00:59:12.440186 ip-10-0-131-57 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 00:59:12.440186 ip-10-0-131-57 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 00:59:12.441422 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.441330 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 00:59:12.448634 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448607 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:59:12.448634 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448627 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:59:12.448634 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448631 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:59:12.448634 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448634 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:59:12.448634 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448637 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:59:12.448634 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448640 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:59:12.448634 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448645 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448647 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448650 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448653 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448656 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448658 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448661 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448664 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448667 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448669 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448672 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448674 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448677 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448679 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448681 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448684 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448687 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448689 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448692 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448694 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:59:12.448901 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448696 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448699 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448701 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448704 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448706 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448709 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448715 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448717 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448720 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448722 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448725 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448727 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448729 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448732 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448736 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448738 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448741 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448745 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448748 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448751 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:59:12.449400 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448753 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448756 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448758 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448761 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448765 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448767 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448770 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448774 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448776 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448779 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448783 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448786 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448789 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448792 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448795 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448798 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448801 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448803 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448806 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:59:12.449889 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448808 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448811 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448813 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448816 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448818 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448821 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448823 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448826 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448829 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448832 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448835 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448837 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448840 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448842 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448845 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448849 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448851 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448854 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448857 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448859 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:59:12.450351 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448862 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448864 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448867 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448869 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448871 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448874 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448876 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448880 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448883 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448886 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448889 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448891 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448894 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.448896 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449612 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449619 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449622 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449624 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449628 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:59:12.450824 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449632 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449634 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449637 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449640 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449642 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449645 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449648 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449652 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449656 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449659 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449662 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449665 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449668 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449671 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449673 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449676 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449679 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449681 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449684 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:59:12.451283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449687 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449689 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449692 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449696 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449700 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449703 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449705 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449709 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449713 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449715 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449718 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449720 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449723 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449725 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449728 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449731 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449733 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449736 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449738 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:59:12.451844 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449741 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449743 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449746 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449748 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449751 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449753 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449755 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449758 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449761 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449763 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449766 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449768 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449771 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449773 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449776 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449778 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449780 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449783 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449785 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449787 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:59:12.452332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449790 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449793 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449795 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449797 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449799 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449802 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449808 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449811 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449813 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449816 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449818 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449821 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449823 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449826 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449828 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449830 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449833 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449835 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449838 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449840 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:59:12.452829 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449844 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449846 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449849 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449851 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449853 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449856 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449858 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449860 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449863 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449865 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449868 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449870 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449873 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449875 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449877 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.449879 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450284 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450289 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450294 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:59:12.453332 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450297 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450300 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450302 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450305 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450307 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450310 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450312 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450314 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450317 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450320 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450322 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450324 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450327 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450330 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450332 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450335 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450337 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450340 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450343 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:59:12.453781 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450345 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450348 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450350 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450353 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450355 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450358 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450361 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450364 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450366 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450369 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450372 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450374 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450378 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450380 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450383 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450385 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450387 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450390 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450392 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450394 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:59:12.454290 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450397 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450399 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450401 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450404 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450406 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450409 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450411 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450414 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450416 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450418 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450421 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450423 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450427 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450430 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450433 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450436 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450439 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450441 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450444 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450446 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:59:12.454763 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450448 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450451 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450453 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450457 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450461 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450464 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450468 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450471 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450474 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450478 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450481 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450484 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450487 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450490 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450492 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450501 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450504 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450506 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450509 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:59:12.455243 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450511 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450517 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450521 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450524 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450526 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450529 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450531 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450533 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450536 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450538 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450541 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450543 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450545 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450548 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450550 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450552 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450555 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.450558 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450627 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450634 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450640 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 00:59:12.455741 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450644 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450648 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450651 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450655 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450659 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450662 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450665 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450668 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450671 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450674 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450677 2570 flags.go:64] FLAG: --cgroup-root="" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450680 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450682 2570 flags.go:64] FLAG: --client-ca-file="" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450689 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450692 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450696 2570 flags.go:64] FLAG: --cluster-domain="" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450699 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450702 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450705 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450708 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450712 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450715 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450718 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 00:59:12.456257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450721 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450724 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450727 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450730 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450733 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450736 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450740 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450743 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450745 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450748 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450751 2570 flags.go:64] FLAG: --enable-server="true" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450753 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450760 2570 flags.go:64] FLAG: --event-burst="100" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450763 2570 flags.go:64] FLAG: --event-qps="50" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450765 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450768 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450771 2570 flags.go:64] FLAG: --eviction-hard="" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450774 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450777 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450780 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450782 2570 flags.go:64] FLAG: --eviction-soft="" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450785 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450788 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450796 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450799 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 00:59:12.456800 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450802 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450805 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450807 2570 flags.go:64] FLAG: --feature-gates="" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450811 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450814 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450817 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450820 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450823 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450826 2570 flags.go:64] FLAG: --help="false" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450828 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450831 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450834 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450840 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450843 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450847 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450849 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450852 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450855 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450857 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450860 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450863 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450866 2570 flags.go:64] FLAG: --kube-reserved="" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450869 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450871 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 00:59:12.457419 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450874 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450877 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450880 2570 flags.go:64] FLAG: --lock-file="" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450882 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450885 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450888 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450893 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450896 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450899 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450902 2570 flags.go:64] FLAG: --logging-format="text" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450904 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450907 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450910 2570 flags.go:64] FLAG: --manifest-url="" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450929 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450936 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450939 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450943 2570 flags.go:64] FLAG: --max-pods="110" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450946 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450949 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450951 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450957 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450960 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450963 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450966 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450973 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 00:59:12.458020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450976 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450979 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450982 2570 flags.go:64] FLAG: --pod-cidr="" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450984 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450989 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450992 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450995 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.450998 2570 flags.go:64] FLAG: --port="10250" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451001 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451004 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0112c567427b5c123" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451006 2570 flags.go:64] FLAG: --qos-reserved="" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451009 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451012 2570 flags.go:64] FLAG: --register-node="true" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451015 2570 flags.go:64] FLAG: --register-with-taints="" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451018 2570 flags.go:64] FLAG: --registry-burst="10" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451027 2570 flags.go:64] FLAG: --registry-qps="5" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451030 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451032 2570 flags.go:64] FLAG: --reserved-memory="" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451036 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451039 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451042 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451045 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451047 2570 flags.go:64] FLAG: --runonce="false" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451050 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451053 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 00:59:12.458615 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451055 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451058 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451062 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451066 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451069 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451072 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451074 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451077 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451080 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451082 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451085 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451088 2570 flags.go:64] FLAG: --system-cgroups="" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451091 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451096 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451099 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451101 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451106 2570 flags.go:64] FLAG: --tls-min-version="" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451109 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451112 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451114 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451117 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451120 2570 flags.go:64] FLAG: --v="2" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451124 2570 flags.go:64] FLAG: --version="false" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451129 2570 flags.go:64] FLAG: --vmodule="" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451132 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 00:59:12.459246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.451136 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451251 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451255 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451258 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451261 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451264 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451267 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451269 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451272 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451276 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451281 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451283 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451286 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451289 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451291 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451294 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451296 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451299 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451301 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451304 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451306 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:59:12.459836 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451309 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451311 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451314 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451316 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451318 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451321 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451323 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451326 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451330 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451333 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451337 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451340 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451342 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451345 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451348 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451352 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451355 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451358 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451361 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:59:12.460364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451363 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451367 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451371 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451373 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451376 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451379 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451381 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451384 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451387 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451389 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451392 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451394 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451396 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451399 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451401 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451404 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451406 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451409 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451411 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451413 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:59:12.460825 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451416 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451418 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451421 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451423 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451426 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451429 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451431 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451434 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451436 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451438 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451441 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451443 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451445 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451452 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451457 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451460 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451463 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451465 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451468 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451471 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:59:12.461309 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451474 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451477 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451480 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451482 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451485 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451487 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451490 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451492 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451495 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451497 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451499 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451502 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451504 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451507 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451509 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451512 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451514 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451520 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451522 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:59:12.461785 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.451525 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.452355 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.459860 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.459878 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.460779 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.460787 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460858 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460865 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460869 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460871 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460874 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460877 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460879 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460883 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:59:12.462283 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460887 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460891 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460896 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460900 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460904 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460907 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460910 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460926 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460929 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460931 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460934 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460936 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460938 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460941 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460943 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460946 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460949 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460951 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460953 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:59:12.462629 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460956 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460959 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460969 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460974 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460978 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460982 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460985 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460987 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460992 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460995 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.460998 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461001 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461004 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461006 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461009 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461012 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461014 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461016 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461019 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:59:12.463094 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461021 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461024 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461026 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461029 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461031 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461034 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461036 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461038 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461041 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461043 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461047 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461051 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461055 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461060 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461063 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461066 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461074 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461077 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461079 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461082 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:59:12.463550 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461084 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461087 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461090 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461092 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461095 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461097 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461099 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461102 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461104 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461107 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461109 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461111 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461113 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461116 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461118 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461120 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461123 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461126 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461130 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461134 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:59:12.464045 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461138 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461143 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461145 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461148 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461150 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461152 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461155 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461157 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461160 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461168 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461171 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461174 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461176 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.461181 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461356 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 00:59:12.464527 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461363 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461366 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461371 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461375 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461379 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461384 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461387 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461390 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461392 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461395 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461397 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461400 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461402 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461406 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461411 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461413 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461416 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461420 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461423 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 00:59:12.464885 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461426 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461429 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461431 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461434 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461436 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461438 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461441 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461443 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461454 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461459 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461463 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461467 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461470 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461472 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461474 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461477 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461479 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461481 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461484 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461486 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 00:59:12.465356 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461488 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461491 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461493 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461495 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461497 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461500 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461502 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461505 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461507 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461509 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461511 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461514 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461516 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461518 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461520 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461523 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461525 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461528 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461532 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 00:59:12.465842 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461536 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461543 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461553 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461556 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461560 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461562 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461565 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461567 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461570 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461572 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461574 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461577 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461579 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461582 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461584 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461587 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461589 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461591 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461594 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461596 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 00:59:12.466431 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461598 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461600 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461604 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461607 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461611 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461616 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461621 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461625 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461629 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461632 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461634 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461636 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461639 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461643 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461646 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461658 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461661 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461664 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461666 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 00:59:12.466899 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:12.461669 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 00:59:12.467376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.461674 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 00:59:12.467376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.461812 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 00:59:12.467376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.464328 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 00:59:12.467376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.466097 2570 server.go:1019] "Starting client certificate rotation" Jul 14 00:59:12.467376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.466199 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 00:59:12.467376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.466933 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 00:59:12.469095 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.469082 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 00:59:12.474263 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.474242 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 00:59:12.485078 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.485060 2570 log.go:25] "Validated CRI v1 runtime API" Jul 14 00:59:12.487529 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.487512 2570 log.go:25] "Validated CRI v1 image API" Jul 14 00:59:12.488378 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.488352 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 00:59:12.491660 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.491638 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 86745b2f-d50a-466b-bc79-d750e8454b80:/dev/nvme0n1p3 afa9c9dc-79a5-4dc9-a059-5594ae4c42d1:/dev/nvme0n1p4] Jul 14 00:59:12.491746 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.491660 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 00:59:12.497281 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.497169 2570 manager.go:216] Machine: {Timestamp:2026-07-14 00:59:12.495654036 +0000 UTC m=+0.366089218 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101765 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21872efbee86484dce2590cb370f89 SystemUUID:ec21872e-fbee-8648-4dce-2590cb370f89 BootID:c411d1a0-c8b7-4fa5-a324-386196deea36 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:77:64:f9:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:77:64:f9:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:b6:50:d7:f9:00 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 00:59:12.497281 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.497272 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 00:59:12.497445 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.497380 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 00:59:12.498742 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.498725 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 00:59:12.500979 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.500903 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 00:59:12.501150 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.500985 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 00:59:12.501859 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.501847 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 00:59:12.501929 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.501866 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 00:59:12.501929 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.501876 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 00:59:12.501929 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.501895 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 00:59:12.503808 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.503795 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 00:59:12.508445 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.508431 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 14 00:59:12.508582 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.508571 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 00:59:12.508637 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.508609 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 14 00:59:12.508637 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.508629 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 00:59:12.508730 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.508648 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 00:59:12.508730 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.508664 2570 kubelet.go:398] "Adding apiserver pod source" Jul 14 00:59:12.508730 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.508676 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 00:59:12.509101 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.509086 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 00:59:12.509161 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.509110 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 00:59:12.512121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.512105 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 00:59:12.514390 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.514374 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 00:59:12.514466 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.514413 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 00:59:12.514633 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.514618 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 00:59:12.514695 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.514645 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 00:59:12.514695 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.514659 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 00:59:12.514695 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.514673 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 00:59:12.514799 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.514733 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 00:59:12.514799 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.514744 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 00:59:12.515291 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.515280 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 00:59:12.515340 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.515294 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 00:59:12.515340 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.515304 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 00:59:12.515340 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.515313 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 00:59:12.515340 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.515331 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 00:59:12.515469 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.515343 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 00:59:12.516226 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.516215 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 00:59:12.516285 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.516229 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 00:59:12.518904 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.518881 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 00:59:12.519005 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.518906 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 00:59:12.519071 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.519025 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 00:59:12.519628 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.519613 2570 server.go:1268] "Started kubelet" Jul 14 00:59:12.519788 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.519726 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 00:59:12.519897 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.519731 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 00:59:12.519897 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.519835 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 00:59:12.520900 ip-10-0-131-57 systemd[1]: Started Kubernetes Kubelet. Jul 14 00:59:12.524417 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.524391 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 00:59:12.525518 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.525492 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 00:59:12.526766 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.526748 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 14 00:59:12.530809 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.529618 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-57.ec2.internal.18c202232e82c7c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-57.ec2.internal,UID:ip-10-0-131-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-57.ec2.internal,},FirstTimestamp:2026-07-14 00:59:12.519571399 +0000 UTC m=+0.390006582,LastTimestamp:2026-07-14 00:59:12.519571399 +0000 UTC m=+0.390006582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-57.ec2.internal,}" Jul 14 00:59:12.533296 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.533276 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 00:59:12.533381 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.533292 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 00:59:12.533429 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.533400 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:12.534065 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534049 2570 factory.go:55] Registering systemd factory Jul 14 00:59:12.534153 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534068 2570 factory.go:223] Registration of the systemd container factory successfully Jul 14 00:59:12.534153 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534111 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 00:59:12.534153 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534124 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 00:59:12.534289 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534247 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 14 00:59:12.534289 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534260 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 14 00:59:12.534445 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534432 2570 factory.go:153] Registering CRI-O factory Jul 14 00:59:12.534520 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534451 2570 factory.go:223] Registration of the crio container factory successfully Jul 14 00:59:12.534520 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534452 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 00:59:12.534520 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534501 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 00:59:12.534709 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534525 2570 factory.go:103] Registering Raw factory Jul 14 00:59:12.534709 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534540 2570 manager.go:1196] Started watching for new ooms in manager Jul 14 00:59:12.534945 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.534909 2570 manager.go:349] Starting recovery of all containers Jul 14 00:59:12.538293 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.538267 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 00:59:12.538418 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.538389 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 00:59:12.543580 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.543461 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldx9f" Jul 14 00:59:12.544114 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.544099 2570 manager.go:354] Recovery completed Jul 14 00:59:12.545524 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.545507 2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 14 00:59:12.549430 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.549415 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:59:12.550141 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.550126 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldx9f" Jul 14 00:59:12.551633 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.551617 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:59:12.551712 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.551653 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:59:12.551712 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.551669 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:59:12.552257 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.552243 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 00:59:12.552315 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.552258 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 00:59:12.552315 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.552275 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 14 00:59:12.552381 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.552244 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:59:12.553119 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.553104 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:59:12.553209 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.553076 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-57.ec2.internal.18c20223306c05cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-57.ec2.internal,UID:ip-10-0-131-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-57.ec2.internal,},FirstTimestamp:2026-07-14 00:59:12.55163438 +0000 UTC m=+0.422069563,LastTimestamp:2026-07-14 00:59:12.55163438 +0000 UTC m=+0.422069563,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-57.ec2.internal,}" Jul 14 00:59:12.553209 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.553134 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:59:12.553209 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.553149 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:59:12.555129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.555118 2570 policy_none.go:49] "None policy: Start" Jul 14 00:59:12.555177 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.555134 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 00:59:12.555177 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.555144 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 00:59:12.557061 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.557049 2570 policy_none.go:47] "Start" Jul 14 00:59:12.626998 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.626299 2570 manager.go:337] "Starting Device Plugin manager" Jul 14 00:59:12.626998 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.626335 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 00:59:12.626998 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.626349 2570 server.go:87] "Starting device plugin registration server" Jul 14 00:59:12.626998 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.626609 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 00:59:12.626998 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.626619 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 00:59:12.626998 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.626695 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 00:59:12.626998 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.626766 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 00:59:12.626998 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.626774 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 00:59:12.627443 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.627424 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 00:59:12.627494 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.627482 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:12.657582 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.657552 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 00:59:12.658878 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.658862 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 00:59:12.658948 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.658904 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 00:59:12.659033 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.658959 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 00:59:12.659033 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.659000 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 00:59:12.661045 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.661022 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:59:12.727197 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.727088 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:59:12.728307 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.728287 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:59:12.728422 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.728322 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:59:12.728422 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.728335 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:59:12.728422 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.728367 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.739984 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.739964 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.740036 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.739989 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-57.ec2.internal\": node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:12.759988 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.759964 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal"] Jul 14 00:59:12.760104 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.760019 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:59:12.760871 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.760854 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:59:12.760989 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.760880 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:59:12.760989 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.760889 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:59:12.763355 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.763343 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:59:12.763485 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.763471 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.763523 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.763500 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:59:12.764093 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.764079 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:59:12.764187 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.764107 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:59:12.764187 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.764121 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:59:12.764187 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.764128 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:59:12.764187 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.764146 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:59:12.764187 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.764155 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:59:12.765782 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.765766 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:12.766373 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.766359 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.766426 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.766385 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 00:59:12.767123 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.767109 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientMemory" Jul 14 00:59:12.767194 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.767133 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 00:59:12.767194 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.767148 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeHasSufficientPID" Jul 14 00:59:12.793667 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.793639 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-57.ec2.internal\" not found" node="ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.797972 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.797952 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-57.ec2.internal\" not found" node="ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.836181 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.836147 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d13832b4e3d1bf8ab5549fca691d02f5-config\") pod \"kube-apiserver-proxy-ip-10-0-131-57.ec2.internal\" (UID: \"d13832b4e3d1bf8ab5549fca691d02f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.836347 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.836194 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0416fe0e4ef3d957aec4e22e873f40ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal\" (UID: \"0416fe0e4ef3d957aec4e22e873f40ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.836347 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.836219 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0416fe0e4ef3d957aec4e22e873f40ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal\" (UID: \"0416fe0e4ef3d957aec4e22e873f40ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.866307 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.866252 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:12.936681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.936658 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0416fe0e4ef3d957aec4e22e873f40ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal\" (UID: \"0416fe0e4ef3d957aec4e22e873f40ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.936804 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.936687 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0416fe0e4ef3d957aec4e22e873f40ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal\" (UID: \"0416fe0e4ef3d957aec4e22e873f40ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.936804 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.936719 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d13832b4e3d1bf8ab5549fca691d02f5-config\") pod \"kube-apiserver-proxy-ip-10-0-131-57.ec2.internal\" (UID: \"d13832b4e3d1bf8ab5549fca691d02f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.936804 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.936770 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d13832b4e3d1bf8ab5549fca691d02f5-config\") pod \"kube-apiserver-proxy-ip-10-0-131-57.ec2.internal\" (UID: \"d13832b4e3d1bf8ab5549fca691d02f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.936804 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.936772 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0416fe0e4ef3d957aec4e22e873f40ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal\" (UID: \"0416fe0e4ef3d957aec4e22e873f40ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.936953 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:12.936771 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0416fe0e4ef3d957aec4e22e873f40ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal\" (UID: \"0416fe0e4ef3d957aec4e22e873f40ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:12.966821 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:12.966770 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.067697 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.067619 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.095844 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.095814 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" Jul 14 00:59:13.101573 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.100680 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:13.168198 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.168143 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.268757 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.268724 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.369383 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.369310 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.464827 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.464790 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 00:59:13.465416 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.464989 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 00:59:13.469987 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.469950 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.555574 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.555524 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 00:54:13 +0000 UTC" deadline="2028-01-23 09:10:06.049087588 +0000 UTC" Jul 14 00:59:13.555574 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.555564 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13400h10m52.493527356s" Jul 14 00:59:13.569718 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.569688 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:59:13.570125 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.570104 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.670439 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.670417 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.714009 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.713976 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:59:13.743070 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:13.743040 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13832b4e3d1bf8ab5549fca691d02f5.slice/crio-931774c5257cf55260004c0b1de32d6d98f28bbc16b3db2693868ea51b93d5bf WatchSource:0}: Error finding container 931774c5257cf55260004c0b1de32d6d98f28bbc16b3db2693868ea51b93d5bf: Status 404 returned error can't find the container with id 931774c5257cf55260004c0b1de32d6d98f28bbc16b3db2693868ea51b93d5bf Jul 14 00:59:13.743572 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:13.743556 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0416fe0e4ef3d957aec4e22e873f40ca.slice/crio-034e78db1ef7ee336b387724f589d4c2294e09490a254d8c175a77b01e62844e WatchSource:0}: Error finding container 034e78db1ef7ee336b387724f589d4c2294e09490a254d8c175a77b01e62844e: Status 404 returned error can't find the container with id 034e78db1ef7ee336b387724f589d4c2294e09490a254d8c175a77b01e62844e Jul 14 00:59:13.747551 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.747534 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 00:59:13.771135 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.771107 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.871675 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:13.871643 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-57.ec2.internal\" not found" Jul 14 00:59:13.911313 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.911285 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:59:13.934126 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.934051 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" Jul 14 00:59:13.943317 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.943296 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 00:59:13.944200 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.944186 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" Jul 14 00:59:13.954861 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:13.954840 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 00:59:14.509645 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.509601 2570 apiserver.go:52] "Watching apiserver" Jul 14 00:59:14.520722 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.520693 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 00:59:14.521853 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.521830 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jjk4z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal","openshift-network-diagnostics/network-check-target-2462s","openshift-network-operator/iptables-alerter-7vq9q","openshift-ovn-kubernetes/ovnkube-node-tvd8l","kube-system/konnectivity-agent-b5jpw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz","openshift-dns/node-resolver-stvd5","openshift-image-registry/node-ca-tsm4n","openshift-multus/multus-additional-cni-plugins-v88rj","openshift-multus/multus-rg4j7","openshift-multus/network-metrics-daemon-5vn5k","kube-system/global-pull-secret-syncer-22rf5"] Jul 14 00:59:14.524656 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.524626 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:14.526979 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.526954 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:14.527113 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.527036 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:14.527221 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.527202 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 00:59:14.527356 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.527337 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6rr7l\"" Jul 14 00:59:14.527422 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.527337 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 00:59:14.529320 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.529299 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.529452 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.529407 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:14.532380 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.532246 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:14.532380 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.532328 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:14.533682 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.533662 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 00:59:14.535121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.535101 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.537582 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.537561 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zwvl4\"" Jul 14 00:59:14.537779 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.537741 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 00:59:14.537850 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.537780 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.537850 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.537804 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:59:14.537850 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.537847 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 00:59:14.540417 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.540339 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7mcvr\"" Jul 14 00:59:14.540641 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.540620 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 00:59:14.540756 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.540703 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 00:59:14.540756 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.540734 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.540873 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.540781 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 00:59:14.541053 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.541034 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 00:59:14.541571 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.541550 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 00:59:14.541655 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.541572 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 00:59:14.543867 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.542888 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.544389 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.544367 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 00:59:14.544494 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.544415 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 00:59:14.544639 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.544623 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kmbpf\"" Jul 14 00:59:14.545144 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545118 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-ovn\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545235 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545235 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545185 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-cni-netd\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545235 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545197 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 00:59:14.545235 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545209 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59c02ce8-6473-4e18-a8d1-f762e45ea446-dbus\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.545385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.545385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545268 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-kubelet\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545292 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-var-lib-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545317 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-etc-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545356 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545380 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545594 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545407 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5e04682-83df-4db2-987e-5c254abb5fee-ovn-node-metrics-cert\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545594 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-log-socket\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545594 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545483 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-cni-bin\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545594 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-env-overrides\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545594 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545565 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcf71f03-db11-4a35-895b-f41d25366613-agent-certs\") pod \"konnectivity-agent-b5jpw\" (UID: \"dcf71f03-db11-4a35-895b-f41d25366613\") " pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:14.545809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545591 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-ovnkube-script-lib\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545618 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbwtg\" (UniqueName: \"kubernetes.io/projected/f5e04682-83df-4db2-987e-5c254abb5fee-kube-api-access-rbwtg\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545685 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcf71f03-db11-4a35-895b-f41d25366613-konnectivity-ca\") pod \"konnectivity-agent-b5jpw\" (UID: \"dcf71f03-db11-4a35-895b-f41d25366613\") " pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:14.545809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545718 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/977902fb-886b-4dcf-a7ff-1336af91ea96-iptables-alerter-script\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.545809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545742 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-systemd\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.545809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545766 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545822 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wlct\" (UniqueName: \"kubernetes.io/projected/1eb58e6e-5b22-467f-8725-65881c70b0b9-kube-api-access-7wlct\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545847 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tbpcp\"" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545876 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59c02ce8-6473-4e18-a8d1-f762e45ea446-kubelet-config\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545900 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-run-netns\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545930 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-node-log\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545955 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.545981 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/977902fb-886b-4dcf-a7ff-1336af91ea96-host-slash\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.546018 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-ovnkube-config\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.546050 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-systemd-units\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.546091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd8zv\" (UniqueName: \"kubernetes.io/projected/977902fb-886b-4dcf-a7ff-1336af91ea96-kube-api-access-cd8zv\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.546121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-slash\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.546129 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.546130 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 00:59:14.546580 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.546163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.546580 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.546483 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 00:59:14.548543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.548202 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.548543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.548386 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9mrb7\"" Jul 14 00:59:14.548702 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.548683 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 00:59:14.548817 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.548797 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 00:59:14.549302 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.549274 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 00:59:14.550826 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.550810 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 00:59:14.550940 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.550823 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 00:59:14.551098 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.551081 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 00:59:14.551201 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.551182 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kzrf6\"" Jul 14 00:59:14.552523 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.551695 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.554353 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.554329 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 00:59:14.554513 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.554496 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 00:59:14.557020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.556361 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xj68r\"" Jul 14 00:59:14.557020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.556496 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 00:59:14.557020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.556531 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.557020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.556600 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 00:59:14.557020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.556732 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 00:59:14.559280 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.559228 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 00:59:14.559280 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.559240 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-52pvx\"" Jul 14 00:59:14.565767 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.565743 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c5qbw" Jul 14 00:59:14.574168 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.574142 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c5qbw" Jul 14 00:59:14.635715 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.635686 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 00:59:14.646945 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.646904 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbwtg\" (UniqueName: \"kubernetes.io/projected/f5e04682-83df-4db2-987e-5c254abb5fee-kube-api-access-rbwtg\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.646945 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.646937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcf71f03-db11-4a35-895b-f41d25366613-konnectivity-ca\") pod \"konnectivity-agent-b5jpw\" (UID: \"dcf71f03-db11-4a35-895b-f41d25366613\") " pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:14.647189 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.646971 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-cnibin\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.647189 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647018 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.647189 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647044 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-cni-multus\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.647189 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/153c1406-f910-420b-b32b-0e191ae821b8-hosts-file\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.647189 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7vzf\" (UniqueName: \"kubernetes.io/projected/153c1406-f910-420b-b32b-0e191ae821b8-kube-api-access-d7vzf\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.647189 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647157 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-systemd\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647189 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647182 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-run-netns\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647206 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-node-log\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647230 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-sys\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647258 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/977902fb-886b-4dcf-a7ff-1336af91ea96-host-slash\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647284 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-ovnkube-config\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647346 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/977902fb-886b-4dcf-a7ff-1336af91ea96-host-slash\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647390 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-run-netns\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647419 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysconfig\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647447 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-kubernetes\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647490 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysctl-conf\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647515 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-lib-modules\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.647568 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647540 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-system-cni-dir\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647587 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-systemd\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647590 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcf71f03-db11-4a35-895b-f41d25366613-konnectivity-ca\") pod \"konnectivity-agent-b5jpw\" (UID: \"dcf71f03-db11-4a35-895b-f41d25366613\") " pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647347 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-node-log\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs5nk\" (UniqueName: \"kubernetes.io/projected/3821f29d-fce5-49ab-90ab-3cdd607117f8-kube-api-access-hs5nk\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647714 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-system-cni-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647752 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-socket-dir-parent\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647783 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-cni-bin\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647803 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-daemon-config\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647822 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd8zv\" (UniqueName: \"kubernetes.io/projected/977902fb-886b-4dcf-a7ff-1336af91ea96-kube-api-access-cd8zv\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647843 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-slash\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647861 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647877 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-socket-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647892 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-multus-certs\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647912 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-etc-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647930 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647940 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-ovnkube-config\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.647985 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.647948 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5e04682-83df-4db2-987e-5c254abb5fee-ovn-node-metrics-cert\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648060 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-slash\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648106 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-run-ovn-kubernetes\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648106 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-etc-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648152 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648209 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-systemd\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648254 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-log-socket\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648275 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-registration-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648292 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-kubelet\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648280 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648358 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-log-socket\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-ovnkube-script-lib\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648402 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-cnibin\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648455 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-os-release\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648478 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-k8s-cni-cncf-io\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648511 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-conf-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.648681 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648536 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-etc-kubernetes\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648564 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/977902fb-886b-4dcf-a7ff-1336af91ea96-iptables-alerter-script\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648615 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wlct\" (UniqueName: \"kubernetes.io/projected/1eb58e6e-5b22-467f-8725-65881c70b0b9-kube-api-access-7wlct\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648658 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59c02ce8-6473-4e18-a8d1-f762e45ea446-kubelet-config\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648690 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-var-lib-kubelet\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.648694 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648730 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.648760 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs podName:1eb58e6e-5b22-467f-8725-65881c70b0b9 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:15.148738946 +0000 UTC m=+3.019174116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs") pod "network-metrics-daemon-5vn5k" (UID: "1eb58e6e-5b22-467f-8725-65881c70b0b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysctl-d\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-hostroot\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648966 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/59c02ce8-6473-4e18-a8d1-f762e45ea446-kubelet-config\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.648995 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/153c1406-f910-420b-b32b-0e191ae821b8-tmp-dir\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649021 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-modprobe-d\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649044 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-run\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.649376 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649071 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rzzc\" (UniqueName: \"kubernetes.io/projected/932cd3a2-e294-46b1-af42-74c665aa74c8-kube-api-access-6rzzc\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-cni-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649166 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/911d28d9-c271-419a-85e2-a9fa7e45268c-cni-binary-copy\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-netns\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649236 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-systemd-units\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649243 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/977902fb-886b-4dcf-a7ff-1336af91ea96-iptables-alerter-script\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649260 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1f6362-7eac-4c69-8e14-cc16b1dfd717-tmp\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649286 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf6b4\" (UniqueName: \"kubernetes.io/projected/db1f6362-7eac-4c69-8e14-cc16b1dfd717-kube-api-access-rf6b4\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-systemd-units\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649311 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-sys-fs\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649345 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vtjr\" (UniqueName: \"kubernetes.io/projected/911d28d9-c271-419a-85e2-a9fa7e45268c-kube-api-access-7vtjr\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649370 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-ovn\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649387 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-cni-netd\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649411 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59c02ce8-6473-4e18-a8d1-f762e45ea446-dbus\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649429 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649446 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-cni-netd\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649463 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-os-release\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.650058 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649491 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649503 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-ovn\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.649565 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649565 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-kubelet\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649595 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-var-lib-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.649608 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret podName:59c02ce8-6473-4e18-a8d1-f762e45ea446 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:15.149596749 +0000 UTC m=+3.020031934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret") pod "global-pull-secret-syncer-22rf5" (UID: "59c02ce8-6473-4e18-a8d1-f762e45ea446") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649651 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-var-lib-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649695 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-ovnkube-script-lib\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649710 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/59c02ce8-6473-4e18-a8d1-f762e45ea446-dbus\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649711 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-kubelet\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649738 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649766 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-host\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649792 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-tuned\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649843 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-run-openvswitch\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649825 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-cni-binary-copy\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649881 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swgkq\" (UniqueName: \"kubernetes.io/projected/b2bd9248-47c5-4260-8895-8ae20844bf63-kube-api-access-swgkq\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.651046 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649910 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3821f29d-fce5-49ab-90ab-3cdd607117f8-serviceca\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.651947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.649975 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-cni-bin\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.650008 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-env-overrides\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.650029 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5e04682-83df-4db2-987e-5c254abb5fee-host-cni-bin\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.650114 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcf71f03-db11-4a35-895b-f41d25366613-agent-certs\") pod \"konnectivity-agent-b5jpw\" (UID: \"dcf71f03-db11-4a35-895b-f41d25366613\") " pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:14.651947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.650144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-device-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.651947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.650170 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3821f29d-fce5-49ab-90ab-3cdd607117f8-host\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.651947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.650395 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5e04682-83df-4db2-987e-5c254abb5fee-env-overrides\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.651947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.651929 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5e04682-83df-4db2-987e-5c254abb5fee-ovn-node-metrics-cert\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.653057 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.653036 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcf71f03-db11-4a35-895b-f41d25366613-agent-certs\") pod \"konnectivity-agent-b5jpw\" (UID: \"dcf71f03-db11-4a35-895b-f41d25366613\") " pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:14.654840 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.654718 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:59:14.654840 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.654743 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:59:14.654840 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.654755 2570 projected.go:196] Error preparing data for projected volume kube-api-access-twg2w for pod openshift-network-diagnostics/network-check-target-2462s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:14.654840 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:14.654813 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w podName:ca916d41-8ccd-4a52-afa1-d11d4879461d nodeName:}" failed. No retries permitted until 2026-07-14 00:59:15.154795807 +0000 UTC m=+3.025230992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-twg2w" (UniqueName: "kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w") pod "network-check-target-2462s" (UID: "ca916d41-8ccd-4a52-afa1-d11d4879461d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:14.655809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.655604 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbwtg\" (UniqueName: \"kubernetes.io/projected/f5e04682-83df-4db2-987e-5c254abb5fee-kube-api-access-rbwtg\") pod \"ovnkube-node-tvd8l\" (UID: \"f5e04682-83df-4db2-987e-5c254abb5fee\") " pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.663773 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.663743 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd8zv\" (UniqueName: \"kubernetes.io/projected/977902fb-886b-4dcf-a7ff-1336af91ea96-kube-api-access-cd8zv\") pod \"iptables-alerter-7vq9q\" (UID: \"977902fb-886b-4dcf-a7ff-1336af91ea96\") " pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.664329 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.664304 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wlct\" (UniqueName: \"kubernetes.io/projected/1eb58e6e-5b22-467f-8725-65881c70b0b9-kube-api-access-7wlct\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:14.665204 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.665116 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" event={"ID":"d13832b4e3d1bf8ab5549fca691d02f5","Type":"ContainerStarted","Data":"931774c5257cf55260004c0b1de32d6d98f28bbc16b3db2693868ea51b93d5bf"} Jul 14 00:59:14.669283 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.669256 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" event={"ID":"0416fe0e4ef3d957aec4e22e873f40ca","Type":"ContainerStarted","Data":"034e78db1ef7ee336b387724f589d4c2294e09490a254d8c175a77b01e62844e"} Jul 14 00:59:14.750707 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750660 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.750707 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750719 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-host\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750748 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-tuned\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750772 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-cni-binary-copy\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750789 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swgkq\" (UniqueName: \"kubernetes.io/projected/b2bd9248-47c5-4260-8895-8ae20844bf63-kube-api-access-swgkq\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750810 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3821f29d-fce5-49ab-90ab-3cdd607117f8-serviceca\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750830 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-device-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3821f29d-fce5-49ab-90ab-3cdd607117f8-host\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750851 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-host\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750861 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-cnibin\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750896 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-cnibin\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750913 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-cni-multus\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.750989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/153c1406-f910-420b-b32b-0e191ae821b8-hosts-file\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.751016 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751016 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7vzf\" (UniqueName: \"kubernetes.io/projected/153c1406-f910-420b-b32b-0e191ae821b8-kube-api-access-d7vzf\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751044 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-sys\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751072 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysconfig\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751099 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-kubernetes\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751124 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysctl-conf\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751150 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-lib-modules\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751175 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-system-cni-dir\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751203 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs5nk\" (UniqueName: \"kubernetes.io/projected/3821f29d-fce5-49ab-90ab-3cdd607117f8-kube-api-access-hs5nk\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751228 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-system-cni-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-socket-dir-parent\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751281 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-cni-bin\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751307 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-daemon-config\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751338 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-socket-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751364 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-multus-certs\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751394 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-systemd\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751422 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-registration-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751450 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-kubelet\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.751777 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751479 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751506 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-cnibin\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-os-release\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751556 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-k8s-cni-cncf-io\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751594 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-conf-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751620 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-etc-kubernetes\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-var-lib-kubelet\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751696 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751737 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysctl-d\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751764 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-hostroot\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751799 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/153c1406-f910-420b-b32b-0e191ae821b8-tmp-dir\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751828 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-modprobe-d\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751860 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-run\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751893 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rzzc\" (UniqueName: \"kubernetes.io/projected/932cd3a2-e294-46b1-af42-74c665aa74c8-kube-api-access-6rzzc\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-cni-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.751964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/911d28d9-c271-419a-85e2-a9fa7e45268c-cni-binary-copy\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.752012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-netns\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.752042 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1f6362-7eac-4c69-8e14-cc16b1dfd717-tmp\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.752643 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.752069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf6b4\" (UniqueName: \"kubernetes.io/projected/db1f6362-7eac-4c69-8e14-cc16b1dfd717-kube-api-access-rf6b4\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.752096 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-sys-fs\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.752131 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vtjr\" (UniqueName: \"kubernetes.io/projected/911d28d9-c271-419a-85e2-a9fa7e45268c-kube-api-access-7vtjr\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.752177 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-os-release\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.752204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.752426 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753018 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753147 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-etc-selinux\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753195 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-cni-multus\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.753543 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/153c1406-f910-420b-b32b-0e191ae821b8-hosts-file\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.754121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753589 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-sys\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.754121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753649 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysconfig\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.754121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753698 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-kubernetes\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.754121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753746 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-tuned\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.754121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753807 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysctl-conf\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.754121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753921 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-lib-modules\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.754121 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.753981 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-system-cni-dir\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.754510 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754331 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-cni-binary-copy\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.754510 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754421 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-device-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.754510 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754471 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3821f29d-fce5-49ab-90ab-3cdd607117f8-host\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.754510 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754475 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-cni-bin\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.754748 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754538 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-socket-dir-parent\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.754748 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754536 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3821f29d-fce5-49ab-90ab-3cdd607117f8-serviceca\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.754748 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754603 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-sysctl-d\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.754748 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754660 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-daemon-config\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.754748 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754696 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-system-cni-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.754748 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754728 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-registration-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.754748 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754738 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-netns\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.755109 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754774 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-systemd\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.755109 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754789 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-etc-modprobe-d\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.755109 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754819 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-var-lib-kubelet\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.755109 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754838 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-hostroot\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.755109 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755049 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/911d28d9-c271-419a-85e2-a9fa7e45268c-cni-binary-copy\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.755385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755126 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-run\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.755385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755154 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/153c1406-f910-420b-b32b-0e191ae821b8-tmp-dir\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.755385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755221 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-cni-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.755385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.754665 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-socket-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.755385 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755334 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2bd9248-47c5-4260-8895-8ae20844bf63-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.755581 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755417 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2bd9248-47c5-4260-8895-8ae20844bf63-os-release\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.755581 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755430 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-cnibin\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.755581 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755474 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-multus-conf-dir\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.755581 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755491 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db1f6362-7eac-4c69-8e14-cc16b1dfd717-var-lib-kubelet\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.755581 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755499 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-sys-fs\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.755581 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755556 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/932cd3a2-e294-46b1-af42-74c665aa74c8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.755581 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755577 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-os-release\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.756005 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755595 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-etc-kubernetes\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.756005 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755623 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-k8s-cni-cncf-io\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.756005 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.755638 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/911d28d9-c271-419a-85e2-a9fa7e45268c-host-run-multus-certs\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.759370 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.759306 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1f6362-7eac-4c69-8e14-cc16b1dfd717-tmp\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.762960 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.762881 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swgkq\" (UniqueName: \"kubernetes.io/projected/b2bd9248-47c5-4260-8895-8ae20844bf63-kube-api-access-swgkq\") pod \"multus-additional-cni-plugins-v88rj\" (UID: \"b2bd9248-47c5-4260-8895-8ae20844bf63\") " pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.763790 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.763759 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs5nk\" (UniqueName: \"kubernetes.io/projected/3821f29d-fce5-49ab-90ab-3cdd607117f8-kube-api-access-hs5nk\") pod \"node-ca-tsm4n\" (UID: \"3821f29d-fce5-49ab-90ab-3cdd607117f8\") " pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.764611 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.764591 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7vzf\" (UniqueName: \"kubernetes.io/projected/153c1406-f910-420b-b32b-0e191ae821b8-kube-api-access-d7vzf\") pod \"node-resolver-stvd5\" (UID: \"153c1406-f910-420b-b32b-0e191ae821b8\") " pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.764919 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.764888 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vtjr\" (UniqueName: \"kubernetes.io/projected/911d28d9-c271-419a-85e2-a9fa7e45268c-kube-api-access-7vtjr\") pod \"multus-rg4j7\" (UID: \"911d28d9-c271-419a-85e2-a9fa7e45268c\") " pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.766154 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.766129 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rzzc\" (UniqueName: \"kubernetes.io/projected/932cd3a2-e294-46b1-af42-74c665aa74c8-kube-api-access-6rzzc\") pod \"aws-ebs-csi-driver-node-xzllz\" (UID: \"932cd3a2-e294-46b1-af42-74c665aa74c8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.766325 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.766300 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf6b4\" (UniqueName: \"kubernetes.io/projected/db1f6362-7eac-4c69-8e14-cc16b1dfd717-kube-api-access-rf6b4\") pod \"tuned-jjk4z\" (UID: \"db1f6362-7eac-4c69-8e14-cc16b1dfd717\") " pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.837437 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.837400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:14.848251 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.848225 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7vq9q" Jul 14 00:59:14.849655 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:14.849619 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf71f03_db11_4a35_895b_f41d25366613.slice/crio-2456ecac53cabccf1b1878effcd6fbb93c1814f426ca042246f139bab27f0306 WatchSource:0}: Error finding container 2456ecac53cabccf1b1878effcd6fbb93c1814f426ca042246f139bab27f0306: Status 404 returned error can't find the container with id 2456ecac53cabccf1b1878effcd6fbb93c1814f426ca042246f139bab27f0306 Jul 14 00:59:14.858066 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.858045 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 00:59:14.858544 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:14.858523 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977902fb_886b_4dcf_a7ff_1336af91ea96.slice/crio-948a7f8187e419ff1d7dbe8ede3268c0f25bc00a09dd26f1a328b244368a5dd5 WatchSource:0}: Error finding container 948a7f8187e419ff1d7dbe8ede3268c0f25bc00a09dd26f1a328b244368a5dd5: Status 404 returned error can't find the container with id 948a7f8187e419ff1d7dbe8ede3268c0f25bc00a09dd26f1a328b244368a5dd5 Jul 14 00:59:14.860923 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.860890 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:14.867101 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.867070 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stvd5" Jul 14 00:59:14.870954 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:14.870931 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e04682_83df_4db2_987e_5c254abb5fee.slice/crio-21e63993cd3f9048ea607237e61a86ca6e78bfbed2a8ad14e8c52d5fee89af22 WatchSource:0}: Error finding container 21e63993cd3f9048ea607237e61a86ca6e78bfbed2a8ad14e8c52d5fee89af22: Status 404 returned error can't find the container with id 21e63993cd3f9048ea607237e61a86ca6e78bfbed2a8ad14e8c52d5fee89af22 Jul 14 00:59:14.876476 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.876454 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" Jul 14 00:59:14.877432 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:14.877408 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153c1406_f910_420b_b32b_0e191ae821b8.slice/crio-6ae24f264bcb5a494d0374fbff4deac05bfab08c8d9f714ba2e4b84de719847e WatchSource:0}: Error finding container 6ae24f264bcb5a494d0374fbff4deac05bfab08c8d9f714ba2e4b84de719847e: Status 404 returned error can't find the container with id 6ae24f264bcb5a494d0374fbff4deac05bfab08c8d9f714ba2e4b84de719847e Jul 14 00:59:14.885364 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:14.885340 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932cd3a2_e294_46b1_af42_74c665aa74c8.slice/crio-98fba124cfcd00c3029a1e0c659788af507cc86942798c4abce639eb43f155e1 WatchSource:0}: Error finding container 98fba124cfcd00c3029a1e0c659788af507cc86942798c4abce639eb43f155e1: Status 404 returned error can't find the container with id 98fba124cfcd00c3029a1e0c659788af507cc86942798c4abce639eb43f155e1 Jul 14 00:59:14.893145 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.893124 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" Jul 14 00:59:14.902110 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.902086 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tsm4n" Jul 14 00:59:14.903911 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:14.903887 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1f6362_7eac_4c69_8e14_cc16b1dfd717.slice/crio-121af491623ebb453bb80d3bc1bde5a3cd51289828c7b6ef28a0fc5b6d4db2ec WatchSource:0}: Error finding container 121af491623ebb453bb80d3bc1bde5a3cd51289828c7b6ef28a0fc5b6d4db2ec: Status 404 returned error can't find the container with id 121af491623ebb453bb80d3bc1bde5a3cd51289828c7b6ef28a0fc5b6d4db2ec Jul 14 00:59:14.909052 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.909026 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v88rj" Jul 14 00:59:14.917071 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:14.917046 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rg4j7" Jul 14 00:59:14.920014 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:14.919987 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bd9248_47c5_4260_8895_8ae20844bf63.slice/crio-e7aed1605af40f1fb551380c125e7f2d952860c6f6447bf7d47b495b80c1c693 WatchSource:0}: Error finding container e7aed1605af40f1fb551380c125e7f2d952860c6f6447bf7d47b495b80c1c693: Status 404 returned error can't find the container with id e7aed1605af40f1fb551380c125e7f2d952860c6f6447bf7d47b495b80c1c693 Jul 14 00:59:14.931239 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:14.930783 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911d28d9_c271_419a_85e2_a9fa7e45268c.slice/crio-2c7dfa3c52f52743b97f3b8fae947ce6416f74856116a72b6d13c317bbeebb4d WatchSource:0}: Error finding container 2c7dfa3c52f52743b97f3b8fae947ce6416f74856116a72b6d13c317bbeebb4d: Status 404 returned error can't find the container with id 2c7dfa3c52f52743b97f3b8fae947ce6416f74856116a72b6d13c317bbeebb4d Jul 14 00:59:15.155444 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.155355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:15.155444 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.155411 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:15.155638 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.155470 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:15.155638 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.155563 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:59:15.155638 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.155597 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:59:15.155638 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.155610 2570 projected.go:196] Error preparing data for projected volume kube-api-access-twg2w for pod openshift-network-diagnostics/network-check-target-2462s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:15.155638 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.155629 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:15.155836 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.155666 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w podName:ca916d41-8ccd-4a52-afa1-d11d4879461d nodeName:}" failed. No retries permitted until 2026-07-14 00:59:16.155645921 +0000 UTC m=+4.026081092 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg2w" (UniqueName: "kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w") pod "network-check-target-2462s" (UID: "ca916d41-8ccd-4a52-afa1-d11d4879461d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:15.155836 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.155693 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret podName:59c02ce8-6473-4e18-a8d1-f762e45ea446 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:16.155674728 +0000 UTC m=+4.026109920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret") pod "global-pull-secret-syncer-22rf5" (UID: "59c02ce8-6473-4e18-a8d1-f762e45ea446") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:15.155836 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.155569 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:15.155836 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.155728 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs podName:1eb58e6e-5b22-467f-8725-65881c70b0b9 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:16.155717367 +0000 UTC m=+4.026152538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs") pod "network-metrics-daemon-5vn5k" (UID: "1eb58e6e-5b22-467f-8725-65881c70b0b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:15.579977 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.579920 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 00:54:15 +0000 UTC" deadline="2028-02-23 22:41:55.389511689 +0000 UTC" Jul 14 00:59:15.579977 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.579970 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14157h42m39.809545606s" Jul 14 00:59:15.660809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.660246 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:15.660809 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.660393 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:15.660809 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.660441 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:15.660809 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:15.660626 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:15.681335 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.681257 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rg4j7" event={"ID":"911d28d9-c271-419a-85e2-a9fa7e45268c","Type":"ContainerStarted","Data":"2c7dfa3c52f52743b97f3b8fae947ce6416f74856116a72b6d13c317bbeebb4d"} Jul 14 00:59:15.683669 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.683583 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v88rj" event={"ID":"b2bd9248-47c5-4260-8895-8ae20844bf63","Type":"ContainerStarted","Data":"e7aed1605af40f1fb551380c125e7f2d952860c6f6447bf7d47b495b80c1c693"} Jul 14 00:59:15.687213 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.687135 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tsm4n" event={"ID":"3821f29d-fce5-49ab-90ab-3cdd607117f8","Type":"ContainerStarted","Data":"658c183d4451c577e9665d5a9a496f3bb5ac3fbe9d5f53e402e26d2c4b16b7de"} Jul 14 00:59:15.688837 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.688809 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" event={"ID":"932cd3a2-e294-46b1-af42-74c665aa74c8","Type":"ContainerStarted","Data":"98fba124cfcd00c3029a1e0c659788af507cc86942798c4abce639eb43f155e1"} Jul 14 00:59:15.691020 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.690993 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"21e63993cd3f9048ea607237e61a86ca6e78bfbed2a8ad14e8c52d5fee89af22"} Jul 14 00:59:15.695038 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.695009 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b5jpw" event={"ID":"dcf71f03-db11-4a35-895b-f41d25366613","Type":"ContainerStarted","Data":"2456ecac53cabccf1b1878effcd6fbb93c1814f426ca042246f139bab27f0306"} Jul 14 00:59:15.699017 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.698919 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" event={"ID":"db1f6362-7eac-4c69-8e14-cc16b1dfd717","Type":"ContainerStarted","Data":"121af491623ebb453bb80d3bc1bde5a3cd51289828c7b6ef28a0fc5b6d4db2ec"} Jul 14 00:59:15.700848 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.700714 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stvd5" event={"ID":"153c1406-f910-420b-b32b-0e191ae821b8","Type":"ContainerStarted","Data":"6ae24f264bcb5a494d0374fbff4deac05bfab08c8d9f714ba2e4b84de719847e"} Jul 14 00:59:15.702576 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:15.702548 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7vq9q" event={"ID":"977902fb-886b-4dcf-a7ff-1336af91ea96","Type":"ContainerStarted","Data":"948a7f8187e419ff1d7dbe8ede3268c0f25bc00a09dd26f1a328b244368a5dd5"} Jul 14 00:59:16.163373 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:16.163109 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:16.163373 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:16.163338 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:16.163373 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:16.163375 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:16.163668 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.163450 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:16.163668 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.163475 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:16.163668 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.163528 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs podName:1eb58e6e-5b22-467f-8725-65881c70b0b9 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:18.163508551 +0000 UTC m=+6.033943725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs") pod "network-metrics-daemon-5vn5k" (UID: "1eb58e6e-5b22-467f-8725-65881c70b0b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:16.163668 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.163549 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret podName:59c02ce8-6473-4e18-a8d1-f762e45ea446 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:18.163539116 +0000 UTC m=+6.033974287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret") pod "global-pull-secret-syncer-22rf5" (UID: "59c02ce8-6473-4e18-a8d1-f762e45ea446") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:16.163668 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.163579 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:59:16.163668 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.163591 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:59:16.163668 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.163602 2570 projected.go:196] Error preparing data for projected volume kube-api-access-twg2w for pod openshift-network-diagnostics/network-check-target-2462s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:16.163668 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.163639 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w podName:ca916d41-8ccd-4a52-afa1-d11d4879461d nodeName:}" failed. No retries permitted until 2026-07-14 00:59:18.163625825 +0000 UTC m=+6.034061021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg2w" (UniqueName: "kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w") pod "network-check-target-2462s" (UID: "ca916d41-8ccd-4a52-afa1-d11d4879461d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:16.580980 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:16.580883 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 00:54:15 +0000 UTC" deadline="2028-04-06 06:08:02.112594468 +0000 UTC" Jul 14 00:59:16.580980 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:16.580964 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15173h8m45.531635911s" Jul 14 00:59:16.660172 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:16.660126 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:16.660358 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:16.660289 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:17.660588 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:17.659807 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:17.660588 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:17.659966 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:17.660588 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:17.660392 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:17.660588 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:17.660507 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:18.188826 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:18.188731 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:18.189055 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:18.188878 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:18.189055 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:18.188913 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:18.189203 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.189095 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:59:18.189203 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.189117 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:59:18.189203 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.189131 2570 projected.go:196] Error preparing data for projected volume kube-api-access-twg2w for pod openshift-network-diagnostics/network-check-target-2462s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:18.189203 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.189190 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w podName:ca916d41-8ccd-4a52-afa1-d11d4879461d nodeName:}" failed. No retries permitted until 2026-07-14 00:59:22.189171099 +0000 UTC m=+10.059606275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg2w" (UniqueName: "kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w") pod "network-check-target-2462s" (UID: "ca916d41-8ccd-4a52-afa1-d11d4879461d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:18.189658 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.189637 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:18.189740 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.189698 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret podName:59c02ce8-6473-4e18-a8d1-f762e45ea446 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:22.189680634 +0000 UTC m=+10.060115808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret") pod "global-pull-secret-syncer-22rf5" (UID: "59c02ce8-6473-4e18-a8d1-f762e45ea446") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:18.189816 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.189761 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:18.189816 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.189806 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs podName:1eb58e6e-5b22-467f-8725-65881c70b0b9 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:22.189784637 +0000 UTC m=+10.060219814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs") pod "network-metrics-daemon-5vn5k" (UID: "1eb58e6e-5b22-467f-8725-65881c70b0b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:18.660656 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:18.660048 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:18.660656 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:18.660203 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:19.659774 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:19.659732 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:19.659957 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:19.659882 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:19.660088 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:19.660066 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:19.660206 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:19.660184 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:20.662130 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:20.662090 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:20.662640 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:20.662284 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:21.659842 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:21.659153 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:21.659842 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:21.659293 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:21.659842 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:21.659684 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:21.659842 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:21.659793 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:22.224770 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:22.224862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:22.224896 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.225069 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.225089 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.225103 2570 projected.go:196] Error preparing data for projected volume kube-api-access-twg2w for pod openshift-network-diagnostics/network-check-target-2462s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.225165 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w podName:ca916d41-8ccd-4a52-afa1-d11d4879461d nodeName:}" failed. No retries permitted until 2026-07-14 00:59:30.225146164 +0000 UTC m=+18.095581336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg2w" (UniqueName: "kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w") pod "network-check-target-2462s" (UID: "ca916d41-8ccd-4a52-afa1-d11d4879461d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.225239 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.225274 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret podName:59c02ce8-6473-4e18-a8d1-f762e45ea446 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:30.225262086 +0000 UTC m=+18.095697274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret") pod "global-pull-secret-syncer-22rf5" (UID: "59c02ce8-6473-4e18-a8d1-f762e45ea446") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.225332 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:22.225714 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.225363 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs podName:1eb58e6e-5b22-467f-8725-65881c70b0b9 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:30.225351897 +0000 UTC m=+18.095787072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs") pod "network-metrics-daemon-5vn5k" (UID: "1eb58e6e-5b22-467f-8725-65881c70b0b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:22.660472 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:22.660386 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:22.660626 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:22.660548 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:23.659856 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:23.659827 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:23.659856 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:23.659855 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:23.660276 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:23.659950 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:23.660276 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:23.660097 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:24.659740 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:24.659263 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:24.659740 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:24.659398 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:25.660209 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:25.660134 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:25.660736 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:25.660257 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:25.660736 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:25.660318 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:25.660736 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:25.660450 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:26.660126 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:26.660085 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:26.660323 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:26.660220 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:27.660161 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:27.660128 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:27.660161 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:27.660153 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:27.660673 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:27.660255 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:27.660673 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:27.660391 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:28.659518 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:28.659481 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:28.659715 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:28.659617 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:29.660194 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:29.660159 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:29.660650 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:29.660173 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:29.660650 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:29.660270 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:29.660650 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:29.660350 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:30.288167 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:30.288131 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:30.288350 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:30.288186 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:30.288350 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:30.288204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:30.288350 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.288315 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:30.288350 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.288331 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:59:30.288350 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.288346 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:59:30.288350 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.288355 2570 projected.go:196] Error preparing data for projected volume kube-api-access-twg2w for pod openshift-network-diagnostics/network-check-target-2462s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:30.288588 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.288315 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:30.288588 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.288391 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs podName:1eb58e6e-5b22-467f-8725-65881c70b0b9 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:46.288370783 +0000 UTC m=+34.158805976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs") pod "network-metrics-daemon-5vn5k" (UID: "1eb58e6e-5b22-467f-8725-65881c70b0b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:30.288588 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.288412 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w podName:ca916d41-8ccd-4a52-afa1-d11d4879461d nodeName:}" failed. No retries permitted until 2026-07-14 00:59:46.288401532 +0000 UTC m=+34.158836707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg2w" (UniqueName: "kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w") pod "network-check-target-2462s" (UID: "ca916d41-8ccd-4a52-afa1-d11d4879461d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:30.288588 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.288428 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret podName:59c02ce8-6473-4e18-a8d1-f762e45ea446 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:46.288420337 +0000 UTC m=+34.158855507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret") pod "global-pull-secret-syncer-22rf5" (UID: "59c02ce8-6473-4e18-a8d1-f762e45ea446") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:30.659846 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:30.659808 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:30.660024 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:30.659949 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:31.660114 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:31.660075 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:31.660548 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:31.660196 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:31.660548 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:31.660263 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:31.660548 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:31.660409 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:32.660120 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:32.660085 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:32.660532 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:32.660200 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:33.659291 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:33.659246 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:33.659291 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:33.659273 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:33.659530 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:33.659369 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:33.659530 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:33.659506 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:34.659910 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:34.659859 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:34.660328 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:34.660024 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:35.659532 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.659250 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:35.659686 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.659312 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:35.659686 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:35.659605 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:35.659686 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:35.659678 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:35.750263 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.750236 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rg4j7" event={"ID":"911d28d9-c271-419a-85e2-a9fa7e45268c","Type":"ContainerStarted","Data":"10ca00af063456f5bb9843835b87d1ee7dcc368f3afccf6e4f7fc811d8f08b45"} Jul 14 00:59:35.751733 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.751711 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2bd9248-47c5-4260-8895-8ae20844bf63" containerID="b734c3503c3fc9c03afce6339a2de5cde10971b5e0076919022afa254d052a2e" exitCode=0 Jul 14 00:59:35.751806 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.751772 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v88rj" event={"ID":"b2bd9248-47c5-4260-8895-8ae20844bf63","Type":"ContainerDied","Data":"b734c3503c3fc9c03afce6339a2de5cde10971b5e0076919022afa254d052a2e"} Jul 14 00:59:35.756101 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.756080 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tsm4n" event={"ID":"3821f29d-fce5-49ab-90ab-3cdd607117f8","Type":"ContainerStarted","Data":"f72bea02ca4064f679956c88f227599e4388fb5efee7763ff956d1693a27f55e"} Jul 14 00:59:35.757398 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.757378 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" event={"ID":"932cd3a2-e294-46b1-af42-74c665aa74c8","Type":"ContainerStarted","Data":"a671a48276caa7914363cf2d48f84f82d1ddd5b85471102896bf1a6cb260bbe7"} Jul 14 00:59:35.759892 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.759869 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"f35684f6bc3beb4df4885e951111879410b255314da57a305ce4b2a26a56f2b1"} Jul 14 00:59:35.759992 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.759948 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"5c32c85de28bc3d34ea05f8d3b8f48a113008f130e1aa401a507aaa00abc043d"} Jul 14 00:59:35.759992 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.759978 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"e8cd1493233521ffd15ec515769b12d71e5e228d4ac910a56e4d1ecf2e62a990"} Jul 14 00:59:35.760060 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.760004 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"69452022f8805958e8cff7570ecc4961e14e4bad4d042a4e237f4d46d6c6e153"} Jul 14 00:59:35.760060 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.760031 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"36e5477706ba997486deb0c9363706990443096fd6e109e608faccd9440c8ccb"} Jul 14 00:59:35.761651 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.761629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b5jpw" event={"ID":"dcf71f03-db11-4a35-895b-f41d25366613","Type":"ContainerStarted","Data":"bae64b77f0d6c39b05556a864a5cbca2de1cfe6cc9021d941ce42d244dd9c67d"} Jul 14 00:59:35.762850 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.762833 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" event={"ID":"d13832b4e3d1bf8ab5549fca691d02f5","Type":"ContainerStarted","Data":"ca27a8231030b1bb573980e03c4808c0b7a16756493fca5e0d60f215589fad83"} Jul 14 00:59:35.764510 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.764486 2570 generic.go:356] "Generic (PLEG): container finished" podID="0416fe0e4ef3d957aec4e22e873f40ca" containerID="df207448fadb9ac6f471878d8807378cc4fd7accb2aeb2a640e9f6eed6eb2822" exitCode=0 Jul 14 00:59:35.764619 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.764552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" event={"ID":"0416fe0e4ef3d957aec4e22e873f40ca","Type":"ContainerDied","Data":"df207448fadb9ac6f471878d8807378cc4fd7accb2aeb2a640e9f6eed6eb2822"} Jul 14 00:59:35.768250 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.768228 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" event={"ID":"db1f6362-7eac-4c69-8e14-cc16b1dfd717","Type":"ContainerStarted","Data":"7beadd3003fe7cecada07474b013d1cb8465375b942618191c68d4a1569696fd"} Jul 14 00:59:35.770012 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.769993 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stvd5" event={"ID":"153c1406-f910-420b-b32b-0e191ae821b8","Type":"ContainerStarted","Data":"2605351e080f017c0f0a4f9e521b6a40ab529e8ee697dfdde404859131d5bb4b"} Jul 14 00:59:35.800510 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.800459 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jjk4z" podStartSLOduration=2.692447097 podStartE2EDuration="22.800445248s" totalImagesPullingTime="20.107998151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:35.800323813 +0000 UTC m=+23.670759004" watchObservedRunningTime="2026-07-14 00:59:35.800445248 +0000 UTC m=+23.670880474" Jul 14 00:59:35.813387 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.813351 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tsm4n" podStartSLOduration=2.735907008 podStartE2EDuration="22.813338655s" totalImagesPullingTime="20.077431647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:35.812820291 +0000 UTC m=+23.683255481" watchObservedRunningTime="2026-07-14 00:59:35.813338655 +0000 UTC m=+23.683773843" Jul 14 00:59:35.836667 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.836613 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rg4j7" podStartSLOduration=2.706265361 podStartE2EDuration="22.836593482s" totalImagesPullingTime="20.130328121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:35.836352688 +0000 UTC m=+23.706787899" watchObservedRunningTime="2026-07-14 00:59:35.836593482 +0000 UTC m=+23.707028675" Jul 14 00:59:35.855074 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.855034 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-57.ec2.internal" podStartSLOduration=21.855020148 podStartE2EDuration="21.855020148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:35.854161216 +0000 UTC m=+23.724596406" watchObservedRunningTime="2026-07-14 00:59:35.855020148 +0000 UTC m=+23.725455339" Jul 14 00:59:35.868510 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.868465 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b5jpw" podStartSLOduration=7.136119816 podStartE2EDuration="22.868448839s" totalImagesPullingTime="15.732329023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:35.86794103 +0000 UTC m=+23.738376221" watchObservedRunningTime="2026-07-14 00:59:35.868448839 +0000 UTC m=+23.738884029" Jul 14 00:59:35.881961 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:35.881894 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-stvd5" podStartSLOduration=2.764405479 podStartE2EDuration="22.881879908s" totalImagesPullingTime="20.117474429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:35.881336668 +0000 UTC m=+23.751771861" watchObservedRunningTime="2026-07-14 00:59:35.881879908 +0000 UTC m=+23.752315100" Jul 14 00:59:36.659748 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:36.659717 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:36.659965 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:36.659847 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:36.778999 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:36.778949 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"6f9ce9d8536398a71788ac4262fd8f3d3901077edca07604308e78fc41b472b9"} Jul 14 00:59:36.781174 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:36.781145 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" event={"ID":"0416fe0e4ef3d957aec4e22e873f40ca","Type":"ContainerStarted","Data":"793c04d58a7a5083dd22aa31d92513a6fe2a54f252451fa89cbb55b322a52131"} Jul 14 00:59:36.783714 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:36.783683 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7vq9q" event={"ID":"977902fb-886b-4dcf-a7ff-1336af91ea96","Type":"ContainerStarted","Data":"381a3a2281784c4c02589ca2a5439419bcb4765bda6a072ea15176c5309865b5"} Jul 14 00:59:36.795107 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:36.795056 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-57.ec2.internal" podStartSLOduration=22.795038159 podStartE2EDuration="22.795038159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:36.794532791 +0000 UTC m=+24.664967981" watchObservedRunningTime="2026-07-14 00:59:36.795038159 +0000 UTC m=+24.665473351" Jul 14 00:59:36.808086 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:36.808039 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7vq9q" podStartSLOduration=3.667804958 podStartE2EDuration="23.808026333s" totalImagesPullingTime="20.140221375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:36.807619015 +0000 UTC m=+24.678054207" watchObservedRunningTime="2026-07-14 00:59:36.808026333 +0000 UTC m=+24.678461563" Jul 14 00:59:37.090060 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:37.090031 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 00:59:37.640971 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:37.640838 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T00:59:37.090053834Z","UUID":"3373b9ab-d52e-4424-9e86-e471c1a1108b","Handler":null,"Name":"","Endpoint":""} Jul 14 00:59:37.643622 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:37.643600 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 00:59:37.643773 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:37.643642 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 00:59:37.659295 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:37.659269 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:37.659441 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:37.659297 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:37.659441 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:37.659404 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:37.659536 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:37.659521 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:37.788229 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:37.788194 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" event={"ID":"932cd3a2-e294-46b1-af42-74c665aa74c8","Type":"ContainerStarted","Data":"3011248143b940d519c124e41fdd27e5288ddd054a6f014426fac68197070974"} Jul 14 00:59:38.179429 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:38.179400 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:38.180023 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:38.179993 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:38.660331 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:38.659832 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:38.660331 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:38.659984 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:38.793278 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:38.793236 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" event={"ID":"932cd3a2-e294-46b1-af42-74c665aa74c8","Type":"ContainerStarted","Data":"b586029169381696e66892c35dda6ebc5576565e782aef178b00625c690fc14b"} Jul 14 00:59:38.797151 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:38.797093 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"477f61827f625899288bb8ea8777ecc81a84336eb4f5ce826aa412ff7457e3b3"} Jul 14 00:59:38.797401 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:38.797375 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:38.797806 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:38.797788 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b5jpw" Jul 14 00:59:38.821688 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:38.821645 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xzllz" podStartSLOduration=2.650528808 podStartE2EDuration="25.821628331s" totalImagesPullingTime="23.171099523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:38.809018405 +0000 UTC m=+26.679453598" watchObservedRunningTime="2026-07-14 00:59:38.821628331 +0000 UTC m=+26.692063544" Jul 14 00:59:39.659433 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:39.659221 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:39.659612 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:39.659273 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:39.659612 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:39.659538 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:39.659715 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:39.659633 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:40.659196 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:40.659171 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:40.659827 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:40.659284 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:40.811799 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:40.810564 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" event={"ID":"f5e04682-83df-4db2-987e-5c254abb5fee","Type":"ContainerStarted","Data":"32b27fe79d5e6f11d5094941954a4968827a35737f9bb138bac0e10a5a8c2a87"} Jul 14 00:59:40.811799 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:40.810968 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:40.811799 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:40.811037 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:40.811799 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:40.811086 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:40.833802 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:40.833671 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:40.834087 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:40.833953 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 00:59:40.837612 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:40.837564 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" podStartSLOduration=7.621882373 podStartE2EDuration="27.837547691s" totalImagesPullingTime="20.215665318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:40.836897322 +0000 UTC m=+28.707332515" watchObservedRunningTime="2026-07-14 00:59:40.837547691 +0000 UTC m=+28.707982895" Jul 14 00:59:41.660230 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:41.660050 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:41.660708 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:41.660072 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:41.660708 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:41.660335 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:41.660708 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:41.660370 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:41.813435 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:41.813400 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2bd9248-47c5-4260-8895-8ae20844bf63" containerID="222f6ea328c2d488d42c5245eadadc027fe36605a561fc93c3cb565aedfd9e3d" exitCode=0 Jul 14 00:59:41.813593 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:41.813494 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v88rj" event={"ID":"b2bd9248-47c5-4260-8895-8ae20844bf63","Type":"ContainerDied","Data":"222f6ea328c2d488d42c5245eadadc027fe36605a561fc93c3cb565aedfd9e3d"} Jul 14 00:59:42.661468 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:42.661438 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:42.662071 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:42.661555 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:42.967305 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:42.967274 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2462s"] Jul 14 00:59:42.967449 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:42.967416 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:42.967523 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:42.967506 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:42.970620 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:42.970592 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22rf5"] Jul 14 00:59:42.970751 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:42.970696 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:42.970824 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:42.970796 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:42.971456 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:42.971430 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vn5k"] Jul 14 00:59:42.971558 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:42.971543 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:42.971667 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:42.971645 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:43.821394 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:43.821365 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2bd9248-47c5-4260-8895-8ae20844bf63" containerID="df493811c7786bde76ded12cddca2540810b7e253c792fc4bd427a2d8a9fe1ea" exitCode=0 Jul 14 00:59:43.821749 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:43.821423 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v88rj" event={"ID":"b2bd9248-47c5-4260-8895-8ae20844bf63","Type":"ContainerDied","Data":"df493811c7786bde76ded12cddca2540810b7e253c792fc4bd427a2d8a9fe1ea"} Jul 14 00:59:44.660153 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:44.660119 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:44.660153 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:44.660156 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:44.660359 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:44.660127 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:44.660359 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:44.660235 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:44.660359 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:44.660290 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:44.660481 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:44.660370 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:45.831043 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:45.829406 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2bd9248-47c5-4260-8895-8ae20844bf63" containerID="d028248f7373608803ca045d4732268d5bf827c8f978d7860eac412743a17db6" exitCode=0 Jul 14 00:59:45.831043 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:45.829679 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v88rj" event={"ID":"b2bd9248-47c5-4260-8895-8ae20844bf63","Type":"ContainerDied","Data":"d028248f7373608803ca045d4732268d5bf827c8f978d7860eac412743a17db6"} Jul 14 00:59:46.302367 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:46.302335 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:46.302530 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:46.302372 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:46.302530 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:46.302397 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:46.302530 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.302500 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:46.302530 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.302506 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:46.302530 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.302522 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 00:59:46.302729 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.302548 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 00:59:46.302729 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.302555 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret podName:59c02ce8-6473-4e18-a8d1-f762e45ea446 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:18.302541249 +0000 UTC m=+66.172976438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret") pod "global-pull-secret-syncer-22rf5" (UID: "59c02ce8-6473-4e18-a8d1-f762e45ea446") : object "kube-system"/"original-pull-secret" not registered Jul 14 00:59:46.302729 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.302562 2570 projected.go:196] Error preparing data for projected volume kube-api-access-twg2w for pod openshift-network-diagnostics/network-check-target-2462s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:46.302729 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.302581 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs podName:1eb58e6e-5b22-467f-8725-65881c70b0b9 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:18.30256036 +0000 UTC m=+66.172995532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs") pod "network-metrics-daemon-5vn5k" (UID: "1eb58e6e-5b22-467f-8725-65881c70b0b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 00:59:46.302729 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.302609 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w podName:ca916d41-8ccd-4a52-afa1-d11d4879461d nodeName:}" failed. No retries permitted until 2026-07-14 01:00:18.302592805 +0000 UTC m=+66.173027988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-twg2w" (UniqueName: "kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w") pod "network-check-target-2462s" (UID: "ca916d41-8ccd-4a52-afa1-d11d4879461d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 00:59:46.660119 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:46.659657 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:46.660119 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:46.659657 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:46.660119 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.659793 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vn5k" podUID="1eb58e6e-5b22-467f-8725-65881c70b0b9" Jul 14 00:59:46.660119 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:46.659849 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:46.660119 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.659957 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rf5" podUID="59c02ce8-6473-4e18-a8d1-f762e45ea446" Jul 14 00:59:46.660119 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:46.660045 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2462s" podUID="ca916d41-8ccd-4a52-afa1-d11d4879461d" Jul 14 00:59:47.907348 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.907282 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-57.ec2.internal" event="NodeReady" Jul 14 00:59:47.907787 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.907424 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 00:59:47.939958 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.939883 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-749c5644cd-mrk7v"] Jul 14 00:59:47.944077 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.944052 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:47.946466 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.946444 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 00:59:47.946466 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.946465 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 00:59:47.946658 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.946469 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gn7kr\"" Jul 14 00:59:47.946720 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.946707 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 00:59:47.955995 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.955975 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 00:59:47.961102 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.961083 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749c5644cd-mrk7v"] Jul 14 00:59:47.961662 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.961644 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z2s8x"] Jul 14 00:59:47.966079 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.966055 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2d26n"] Jul 14 00:59:47.966178 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.966163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:47.968531 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.968510 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 00:59:47.968531 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.968510 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x8vr9\"" Jul 14 00:59:47.968707 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.968588 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 00:59:47.970085 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.970062 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2d26n" Jul 14 00:59:47.970382 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.970358 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z2s8x"] Jul 14 00:59:47.972229 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.972209 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 00:59:47.972706 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.972688 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fbz48\"" Jul 14 00:59:47.972909 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.972896 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 00:59:47.973135 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.973115 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 00:59:47.985668 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:47.985646 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2d26n"] Jul 14 00:59:48.014589 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.014562 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsf6z\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-kube-api-access-dsf6z\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.014763 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.014642 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-trusted-ca\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.014763 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.014688 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.014763 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.014737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-installation-pull-secrets\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.014994 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.014794 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-certificates\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.014994 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.014826 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-ca-trust-extracted\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.014994 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.014864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-bound-sa-token\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.014994 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.014909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-image-registry-private-configuration\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.116220 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.116369 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116240 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-image-registry-private-configuration\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.116369 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116269 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-config-volume\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.116369 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116358 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsf6z\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-kube-api-access-dsf6z\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.116531 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116393 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc-cert\") pod \"ingress-canary-2d26n\" (UID: \"a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc\") " pod="openshift-ingress-canary/ingress-canary-2d26n" Jul 14 00:59:48.116531 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-tmp-dir\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.116531 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116446 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzqs8\" (UniqueName: \"kubernetes.io/projected/a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc-kube-api-access-mzqs8\") pod \"ingress-canary-2d26n\" (UID: \"a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc\") " pod="openshift-ingress-canary/ingress-canary-2d26n" Jul 14 00:59:48.116531 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116510 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-trusted-ca\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.116703 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116537 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m58vz\" (UniqueName: \"kubernetes.io/projected/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-kube-api-access-m58vz\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.116703 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116570 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.116703 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116597 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-installation-pull-secrets\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.116703 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116666 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-certificates\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.116874 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116709 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-ca-trust-extracted\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.116874 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.116747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-bound-sa-token\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.117273 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.117252 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-certificates\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.117349 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.117285 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-ca-trust-extracted\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.117429 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.117409 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:59:48.117484 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.117434 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749c5644cd-mrk7v: secret "image-registry-tls" not found Jul 14 00:59:48.117527 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.117501 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls podName:0733d9ff-74bf-4f4d-a509-6a659b58d3b6 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:48.617483096 +0000 UTC m=+36.487918269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls") pod "image-registry-749c5644cd-mrk7v" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6") : secret "image-registry-tls" not found Jul 14 00:59:48.117579 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.117551 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-trusted-ca\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.120995 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.120969 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-installation-pull-secrets\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.124457 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.124431 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-image-registry-private-configuration\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.125983 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.125941 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsf6z\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-kube-api-access-dsf6z\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.126085 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.125993 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-bound-sa-token\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.126499 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.126468 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:48.205155 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.205105 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:48.218111 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.218081 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m58vz\" (UniqueName: \"kubernetes.io/projected/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-kube-api-access-m58vz\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.218258 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.218154 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.218258 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.218189 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-config-volume\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.218258 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.218227 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc-cert\") pod \"ingress-canary-2d26n\" (UID: \"a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc\") " pod="openshift-ingress-canary/ingress-canary-2d26n" Jul 14 00:59:48.218258 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.218250 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-tmp-dir\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.218461 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.218277 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzqs8\" (UniqueName: \"kubernetes.io/projected/a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc-kube-api-access-mzqs8\") pod \"ingress-canary-2d26n\" (UID: \"a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc\") " pod="openshift-ingress-canary/ingress-canary-2d26n" Jul 14 00:59:48.218461 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.218310 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:59:48.218461 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.218387 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls podName:c771e3b9-fdcf-4ee3-91b1-3bb92e487c71 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:48.718365083 +0000 UTC m=+36.588800272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls") pod "dns-default-z2s8x" (UID: "c771e3b9-fdcf-4ee3-91b1-3bb92e487c71") : secret "dns-default-metrics-tls" not found Jul 14 00:59:48.218817 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.218797 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-tmp-dir\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.219007 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.218989 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-config-volume\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.221307 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.221286 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc-cert\") pod \"ingress-canary-2d26n\" (UID: \"a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc\") " pod="openshift-ingress-canary/ingress-canary-2d26n" Jul 14 00:59:48.229075 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.229053 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m58vz\" (UniqueName: \"kubernetes.io/projected/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-kube-api-access-m58vz\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.229644 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.229622 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzqs8\" (UniqueName: \"kubernetes.io/projected/a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc-kube-api-access-mzqs8\") pod \"ingress-canary-2d26n\" (UID: \"a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc\") " pod="openshift-ingress-canary/ingress-canary-2d26n" Jul 14 00:59:48.284815 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.284784 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2d26n" Jul 14 00:59:48.434984 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.434951 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2d26n"] Jul 14 00:59:48.441091 ip-10-0-131-57 kubenswrapper[2570]: W0714 00:59:48.441062 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77de954_e2b0_4129_b2c7_2f8ea2dfdbcc.slice/crio-49700b81263e36c3342a4a75f69d9c8d022c8f4024ee1d742fb995286f1e1d37 WatchSource:0}: Error finding container 49700b81263e36c3342a4a75f69d9c8d022c8f4024ee1d742fb995286f1e1d37: Status 404 returned error can't find the container with id 49700b81263e36c3342a4a75f69d9c8d022c8f4024ee1d742fb995286f1e1d37 Jul 14 00:59:48.622006 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.621910 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:48.622146 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.622088 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:59:48.622146 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.622111 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749c5644cd-mrk7v: secret "image-registry-tls" not found Jul 14 00:59:48.622210 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.622175 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls podName:0733d9ff-74bf-4f4d-a509-6a659b58d3b6 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:49.62215311 +0000 UTC m=+37.492588290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls") pod "image-registry-749c5644cd-mrk7v" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6") : secret "image-registry-tls" not found Jul 14 00:59:48.659529 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.659497 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 00:59:48.659690 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.659494 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 00:59:48.659690 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.659493 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 00:59:48.662162 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.662138 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 00:59:48.662162 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.662159 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-btv6j\"" Jul 14 00:59:48.662422 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.662204 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 00:59:48.662422 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.662362 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 00:59:48.662535 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.662427 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 00:59:48.663246 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.663082 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hm62n\"" Jul 14 00:59:48.723022 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.722989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:48.723147 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.723131 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:59:48.723208 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:48.723196 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls podName:c771e3b9-fdcf-4ee3-91b1-3bb92e487c71 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:49.723175239 +0000 UTC m=+37.593610410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls") pod "dns-default-z2s8x" (UID: "c771e3b9-fdcf-4ee3-91b1-3bb92e487c71") : secret "dns-default-metrics-tls" not found Jul 14 00:59:48.838807 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:48.838598 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2d26n" event={"ID":"a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc","Type":"ContainerStarted","Data":"49700b81263e36c3342a4a75f69d9c8d022c8f4024ee1d742fb995286f1e1d37"} Jul 14 00:59:49.629332 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:49.629294 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:49.630009 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:49.629499 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:59:49.630009 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:49.629516 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749c5644cd-mrk7v: secret "image-registry-tls" not found Jul 14 00:59:49.630009 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:49.629584 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls podName:0733d9ff-74bf-4f4d-a509-6a659b58d3b6 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:51.629556453 +0000 UTC m=+39.499991632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls") pod "image-registry-749c5644cd-mrk7v" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6") : secret "image-registry-tls" not found Jul 14 00:59:49.730140 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:49.730107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:49.730692 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:49.730672 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:59:49.730789 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:49.730736 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls podName:c771e3b9-fdcf-4ee3-91b1-3bb92e487c71 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:51.730721919 +0000 UTC m=+39.601157092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls") pod "dns-default-z2s8x" (UID: "c771e3b9-fdcf-4ee3-91b1-3bb92e487c71") : secret "dns-default-metrics-tls" not found Jul 14 00:59:50.850564 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:50.850529 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2bd9248-47c5-4260-8895-8ae20844bf63" containerID="e687efcf6f71a4f726add60015cc2766db6f6bcb65d3af51b640b2d279139133" exitCode=0 Jul 14 00:59:50.850992 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:50.850599 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v88rj" event={"ID":"b2bd9248-47c5-4260-8895-8ae20844bf63","Type":"ContainerDied","Data":"e687efcf6f71a4f726add60015cc2766db6f6bcb65d3af51b640b2d279139133"} Jul 14 00:59:51.647445 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:51.647407 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:51.647652 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:51.647565 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:59:51.647652 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:51.647588 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749c5644cd-mrk7v: secret "image-registry-tls" not found Jul 14 00:59:51.647763 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:51.647657 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls podName:0733d9ff-74bf-4f4d-a509-6a659b58d3b6 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:55.64764146 +0000 UTC m=+43.518076629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls") pod "image-registry-749c5644cd-mrk7v" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6") : secret "image-registry-tls" not found Jul 14 00:59:51.748037 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:51.748000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:51.748220 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:51.748194 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:59:51.748287 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:51.748279 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls podName:c771e3b9-fdcf-4ee3-91b1-3bb92e487c71 nodeName:}" failed. No retries permitted until 2026-07-14 00:59:55.748256595 +0000 UTC m=+43.618691787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls") pod "dns-default-z2s8x" (UID: "c771e3b9-fdcf-4ee3-91b1-3bb92e487c71") : secret "dns-default-metrics-tls" not found Jul 14 00:59:51.857154 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:51.857118 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2bd9248-47c5-4260-8895-8ae20844bf63" containerID="df2b8ca2bbb3d5be4aa90847b6f3dc0f31013e6c7af6df4d03630be8ee4d7c78" exitCode=0 Jul 14 00:59:51.857581 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:51.857161 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v88rj" event={"ID":"b2bd9248-47c5-4260-8895-8ae20844bf63","Type":"ContainerDied","Data":"df2b8ca2bbb3d5be4aa90847b6f3dc0f31013e6c7af6df4d03630be8ee4d7c78"} Jul 14 00:59:52.410396 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:52.410370 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:52.510947 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:52.510811 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:52.862467 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:52.862375 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v88rj" event={"ID":"b2bd9248-47c5-4260-8895-8ae20844bf63","Type":"ContainerStarted","Data":"f821d7336d91838d0eb7b6593715f8fa1f94368cc77a298be64fffc06c2d3b69"} Jul 14 00:59:52.863730 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:52.863705 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2d26n" event={"ID":"a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc","Type":"ContainerStarted","Data":"938c1a715996100f284ca7cafba24e19d2b6b4885293f8c3e4df218ff9021b16"} Jul 14 00:59:52.883006 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:52.882964 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v88rj" podStartSLOduration=8.298153744 podStartE2EDuration="39.882949816s" totalImagesPullingTime="31.584796072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:52.881176697 +0000 UTC m=+40.751611887" watchObservedRunningTime="2026-07-14 00:59:52.882949816 +0000 UTC m=+40.753385006" Jul 14 00:59:52.895807 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:52.895765 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2d26n" podStartSLOduration=1.923145394 podStartE2EDuration="5.895754585s" totalImagesPullingTime="3.972609191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 00:59:52.895491558 +0000 UTC m=+40.765926748" watchObservedRunningTime="2026-07-14 00:59:52.895754585 +0000 UTC m=+40.766189753" Jul 14 00:59:53.010055 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:53.010019 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:53.061745 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:53.061710 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:54.165269 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:54.165236 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:54.265496 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:54.265467 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:55.066223 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:55.066192 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:55.164775 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:55.164746 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:55.680360 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:55.680329 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 00:59:55.680708 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:55.680466 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 00:59:55.680708 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:55.680480 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749c5644cd-mrk7v: secret "image-registry-tls" not found Jul 14 00:59:55.680708 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:55.680535 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls podName:0733d9ff-74bf-4f4d-a509-6a659b58d3b6 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:03.680518043 +0000 UTC m=+51.550953234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls") pod "image-registry-749c5644cd-mrk7v" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6") : secret "image-registry-tls" not found Jul 14 00:59:55.781195 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:55.781159 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 00:59:55.781296 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:55.781284 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 00:59:55.781348 ip-10-0-131-57 kubenswrapper[2570]: E0714 00:59:55.781339 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls podName:c771e3b9-fdcf-4ee3-91b1-3bb92e487c71 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:03.781326047 +0000 UTC m=+51.651761217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls") pod "dns-default-z2s8x" (UID: "c771e3b9-fdcf-4ee3-91b1-3bb92e487c71") : secret "dns-default-metrics-tls" not found Jul 14 00:59:57.086797 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:57.086767 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:57.250301 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:57.250263 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:57.307334 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:57.307302 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:58.730602 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:58.730565 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:58.890241 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:58.890190 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:58.968350 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:58.968310 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:59.044646 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:59.044561 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:59.145599 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:59.145539 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:59.820357 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:59.820314 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 00:59:59.874817 ip-10-0-131-57 kubenswrapper[2570]: I0714 00:59:59.874774 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:00.259982 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:00.259944 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:00.311188 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:00.311162 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:03.742948 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:03.742893 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:00:03.743338 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:03.743043 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 01:00:03.743338 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:03.743061 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749c5644cd-mrk7v: secret "image-registry-tls" not found Jul 14 01:00:03.743338 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:03.743122 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls podName:0733d9ff-74bf-4f4d-a509-6a659b58d3b6 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:19.74310781 +0000 UTC m=+67.613542979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls") pod "image-registry-749c5644cd-mrk7v" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6") : secret "image-registry-tls" not found Jul 14 01:00:03.843899 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:03.843836 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 01:00:03.844105 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:03.844028 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 01:00:03.844158 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:03.844110 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls podName:c771e3b9-fdcf-4ee3-91b1-3bb92e487c71 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:19.84408785 +0000 UTC m=+67.714523039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls") pod "dns-default-z2s8x" (UID: "c771e3b9-fdcf-4ee3-91b1-3bb92e487c71") : secret "dns-default-metrics-tls" not found Jul 14 01:00:06.520989 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:06.520944 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:06.571865 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:06.571833 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:11.247284 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:11.247241 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:11.422324 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:11.422290 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:12.830285 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:12.830260 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tvd8l" Jul 14 01:00:12.981712 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:12.981671 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:13.084208 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.084117 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:13.658255 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.658219 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-5g8st"] Jul 14 01:00:13.690811 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.690775 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-5g8st"] Jul 14 01:00:13.691005 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.690940 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:13.693278 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.693252 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 01:00:13.693278 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.693255 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 01:00:13.693434 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.693277 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t9267\"" Jul 14 01:00:13.714648 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.714609 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:13.714810 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.714666 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d7d8424-4118-4a20-877a-8f109a1328ce-nginx-conf\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:13.760198 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.760164 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8fbcfbfcd-rwqtd"] Jul 14 01:00:13.781366 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.781333 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8fbcfbfcd-rwqtd"] Jul 14 01:00:13.781529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.781425 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.784610 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.784582 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 01:00:13.785186 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.785161 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 01:00:13.785309 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.785205 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 01:00:13.785309 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.785218 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 01:00:13.785465 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.785451 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 01:00:13.785530 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.785513 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 01:00:13.785820 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.785806 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bcz5r\"" Jul 14 01:00:13.790492 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.790465 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:13.815705 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.815676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-default-certificate\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.815862 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.815711 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.815862 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.815743 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:13.815862 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.815774 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d7d8424-4118-4a20-877a-8f109a1328ce-nginx-conf\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:13.815862 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.815803 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-stats-auth\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.815862 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.815831 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8bsk\" (UniqueName: \"kubernetes.io/projected/6d2d685e-55ee-4bf4-8bf4-eebecf331634-kube-api-access-h8bsk\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.815862 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:13.815862 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 01:00:13.815862 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.815895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.816274 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:13.816000 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert podName:1d7d8424-4118-4a20-877a-8f109a1328ce nodeName:}" failed. No retries permitted until 2026-07-14 01:00:14.315978483 +0000 UTC m=+62.186413665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5g8st" (UID: "1d7d8424-4118-4a20-877a-8f109a1328ce") : secret "networking-console-plugin-cert" not found Jul 14 01:00:13.816362 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.816344 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d7d8424-4118-4a20-877a-8f109a1328ce-nginx-conf\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:13.858108 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.858077 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt"] Jul 14 01:00:13.867531 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.867505 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:13.879691 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.879660 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt"] Jul 14 01:00:13.879818 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.879753 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:13.883296 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.883274 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 01:00:13.883296 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.883288 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 01:00:13.883484 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.883396 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6twfb\"" Jul 14 01:00:13.883571 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.883554 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 01:00:13.883625 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.883593 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 01:00:13.917069 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.917042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27hnl\" (UniqueName: \"kubernetes.io/projected/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-kube-api-access-27hnl\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:13.917242 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.917112 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-stats-auth\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.917242 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.917149 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bsk\" (UniqueName: \"kubernetes.io/projected/6d2d685e-55ee-4bf4-8bf4-eebecf331634-kube-api-access-h8bsk\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.917242 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.917220 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.917395 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.917246 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:13.917395 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.917275 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-default-certificate\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.917395 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.917332 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.917395 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.917371 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:13.917582 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:13.917394 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:14.417374643 +0000 UTC m=+62.287809813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : configmap references non-existent config key: service-ca.crt Jul 14 01:00:13.917582 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:13.917436 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 01:00:13.917582 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:13.917490 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:14.417474559 +0000 UTC m=+62.287909749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : secret "router-metrics-certs-default" not found Jul 14 01:00:13.921293 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.921257 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-stats-auth\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.921404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.921257 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-default-certificate\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.927547 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.927517 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8bsk\" (UniqueName: \"kubernetes.io/projected/6d2d685e-55ee-4bf4-8bf4-eebecf331634-kube-api-access-h8bsk\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:13.928404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:13.928382 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:14.018525 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.018487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:14.018705 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.018545 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:14.018705 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.018588 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27hnl\" (UniqueName: \"kubernetes.io/projected/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-kube-api-access-27hnl\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:14.018705 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.018662 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:14.018809 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.018734 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls podName:768f3d5e-e7d7-4b02-90b2-9e2afd19aa79 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:14.518716001 +0000 UTC m=+62.389151184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dz8tt" (UID: "768f3d5e-e7d7-4b02-90b2-9e2afd19aa79") : secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:14.019255 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.019236 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:14.026940 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.026878 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27hnl\" (UniqueName: \"kubernetes.io/projected/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-kube-api-access-27hnl\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:14.028325 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.028266 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:14.320984 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.320881 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:14.321128 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.321040 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 01:00:14.321128 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.321120 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert podName:1d7d8424-4118-4a20-877a-8f109a1328ce nodeName:}" failed. No retries permitted until 2026-07-14 01:00:15.321103516 +0000 UTC m=+63.191538684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5g8st" (UID: "1d7d8424-4118-4a20-877a-8f109a1328ce") : secret "networking-console-plugin-cert" not found Jul 14 01:00:14.421908 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.421876 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:14.421908 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.421935 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:14.422134 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.422020 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 01:00:14.422134 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.422044 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:15.42202768 +0000 UTC m=+63.292462848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : configmap references non-existent config key: service-ca.crt Jul 14 01:00:14.422134 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.422067 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:15.422060215 +0000 UTC m=+63.292495384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : secret "router-metrics-certs-default" not found Jul 14 01:00:14.523193 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.523157 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:14.523408 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.523334 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:14.523473 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:14.523423 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls podName:768f3d5e-e7d7-4b02-90b2-9e2afd19aa79 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:15.523403465 +0000 UTC m=+63.393838656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dz8tt" (UID: "768f3d5e-e7d7-4b02-90b2-9e2afd19aa79") : secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:14.926734 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.926688 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:14.982138 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:14.982108 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:15.330048 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:15.329945 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:15.330204 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:15.330098 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 01:00:15.330204 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:15.330164 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert podName:1d7d8424-4118-4a20-877a-8f109a1328ce nodeName:}" failed. No retries permitted until 2026-07-14 01:00:17.330147819 +0000 UTC m=+65.200582987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5g8st" (UID: "1d7d8424-4118-4a20-877a-8f109a1328ce") : secret "networking-console-plugin-cert" not found Jul 14 01:00:15.431124 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:15.431089 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:15.431285 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:15.431139 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:15.431285 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:15.431247 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 01:00:15.431360 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:15.431299 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:17.431281272 +0000 UTC m=+65.301716441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : secret "router-metrics-certs-default" not found Jul 14 01:00:15.431408 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:15.431372 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:17.431358272 +0000 UTC m=+65.301793458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : configmap references non-existent config key: service-ca.crt Jul 14 01:00:15.532099 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:15.532064 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:15.532246 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:15.532216 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:15.532301 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:15.532292 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls podName:768f3d5e-e7d7-4b02-90b2-9e2afd19aa79 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:17.532277523 +0000 UTC m=+65.402712692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dz8tt" (UID: "768f3d5e-e7d7-4b02-90b2-9e2afd19aa79") : secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:17.131902 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:17.131861 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:17.187125 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:17.187080 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:17.346850 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:17.346802 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:17.347017 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:17.346973 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 01:00:17.347055 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:17.347044 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert podName:1d7d8424-4118-4a20-877a-8f109a1328ce nodeName:}" failed. No retries permitted until 2026-07-14 01:00:21.347024838 +0000 UTC m=+69.217460016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5g8st" (UID: "1d7d8424-4118-4a20-877a-8f109a1328ce") : secret "networking-console-plugin-cert" not found Jul 14 01:00:17.447486 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:17.447443 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:17.447626 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:17.447607 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 01:00:17.447681 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:17.447668 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:21.447651754 +0000 UTC m=+69.318086926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : secret "router-metrics-certs-default" not found Jul 14 01:00:17.447722 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:17.447690 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:21.44768332 +0000 UTC m=+69.318118488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : configmap references non-existent config key: service-ca.crt Jul 14 01:00:17.447722 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:17.447610 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:17.548619 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:17.548573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:17.548726 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:17.548706 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:17.548775 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:17.548769 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls podName:768f3d5e-e7d7-4b02-90b2-9e2afd19aa79 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:21.548754735 +0000 UTC m=+69.419189904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dz8tt" (UID: "768f3d5e-e7d7-4b02-90b2-9e2afd19aa79") : secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:18.354069 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.354024 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 01:00:18.354558 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.354150 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 01:00:18.354558 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.354174 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 01:00:18.356874 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.356842 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 01:00:18.356874 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.356865 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 01:00:18.357052 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.356910 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 01:00:18.365051 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:18.365033 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 01:00:18.365146 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:18.365083 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs podName:1eb58e6e-5b22-467f-8725-65881c70b0b9 nodeName:}" failed. No retries permitted until 2026-07-14 01:01:22.36506972 +0000 UTC m=+130.235504889 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs") pod "network-metrics-daemon-5vn5k" (UID: "1eb58e6e-5b22-467f-8725-65881c70b0b9") : secret "metrics-daemon-secret" not found Jul 14 01:00:18.367008 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.366992 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 01:00:18.367248 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.367230 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/59c02ce8-6473-4e18-a8d1-f762e45ea446-original-pull-secret\") pod \"global-pull-secret-syncer-22rf5\" (UID: \"59c02ce8-6473-4e18-a8d1-f762e45ea446\") " pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 01:00:18.378320 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.378298 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twg2w\" (UniqueName: \"kubernetes.io/projected/ca916d41-8ccd-4a52-afa1-d11d4879461d-kube-api-access-twg2w\") pod \"network-check-target-2462s\" (UID: \"ca916d41-8ccd-4a52-afa1-d11d4879461d\") " pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 01:00:18.383960 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.383943 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rf5" Jul 14 01:00:18.521456 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.521426 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22rf5"] Jul 14 01:00:18.525819 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:18.525795 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c02ce8_6473_4e18_a8d1_f762e45ea446.slice/crio-6ac1b15e7df8eeb855eabcc4bf9eb37feba2ff48b88787ce9405b8fc7d789999 WatchSource:0}: Error finding container 6ac1b15e7df8eeb855eabcc4bf9eb37feba2ff48b88787ce9405b8fc7d789999: Status 404 returned error can't find the container with id 6ac1b15e7df8eeb855eabcc4bf9eb37feba2ff48b88787ce9405b8fc7d789999 Jul 14 01:00:18.680676 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.680652 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-btv6j\"" Jul 14 01:00:18.688902 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.688870 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 01:00:18.806597 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.806558 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2462s"] Jul 14 01:00:18.809779 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:18.809751 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca916d41_8ccd_4a52_afa1_d11d4879461d.slice/crio-b338ee7ecdb64283c19b514c00163d51878858c05dd37f6b7cc49f50ae8e044e WatchSource:0}: Error finding container b338ee7ecdb64283c19b514c00163d51878858c05dd37f6b7cc49f50ae8e044e: Status 404 returned error can't find the container with id b338ee7ecdb64283c19b514c00163d51878858c05dd37f6b7cc49f50ae8e044e Jul 14 01:00:18.925057 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.925017 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2462s" event={"ID":"ca916d41-8ccd-4a52-afa1-d11d4879461d","Type":"ContainerStarted","Data":"b338ee7ecdb64283c19b514c00163d51878858c05dd37f6b7cc49f50ae8e044e"} Jul 14 01:00:18.926082 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:18.926054 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22rf5" event={"ID":"59c02ce8-6473-4e18-a8d1-f762e45ea446","Type":"ContainerStarted","Data":"6ac1b15e7df8eeb855eabcc4bf9eb37feba2ff48b88787ce9405b8fc7d789999"} Jul 14 01:00:19.765677 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:19.765633 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:00:19.766102 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:19.765810 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 01:00:19.766102 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:19.765833 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749c5644cd-mrk7v: secret "image-registry-tls" not found Jul 14 01:00:19.766102 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:19.765898 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls podName:0733d9ff-74bf-4f4d-a509-6a659b58d3b6 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:51.765876757 +0000 UTC m=+99.636311941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls") pod "image-registry-749c5644cd-mrk7v" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6") : secret "image-registry-tls" not found Jul 14 01:00:19.866443 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:19.866406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 01:00:19.866640 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:19.866587 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 01:00:19.866703 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:19.866662 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls podName:c771e3b9-fdcf-4ee3-91b1-3bb92e487c71 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:51.866641077 +0000 UTC m=+99.737076247 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls") pod "dns-default-z2s8x" (UID: "c771e3b9-fdcf-4ee3-91b1-3bb92e487c71") : secret "dns-default-metrics-tls" not found Jul 14 01:00:21.379330 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:21.379251 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:21.379794 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:21.379413 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 01:00:21.379794 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:21.379486 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert podName:1d7d8424-4118-4a20-877a-8f109a1328ce nodeName:}" failed. No retries permitted until 2026-07-14 01:00:29.379464497 +0000 UTC m=+77.249899688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5g8st" (UID: "1d7d8424-4118-4a20-877a-8f109a1328ce") : secret "networking-console-plugin-cert" not found Jul 14 01:00:21.480394 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:21.480355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:21.480561 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:21.480408 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:21.480632 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:21.480564 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:29.480538759 +0000 UTC m=+77.350973945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : configmap references non-existent config key: service-ca.crt Jul 14 01:00:21.480632 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:21.480572 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 01:00:21.480632 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:21.480624 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:29.48061365 +0000 UTC m=+77.351048836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : secret "router-metrics-certs-default" not found Jul 14 01:00:21.581593 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:21.581551 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:21.581769 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:21.581700 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:21.581769 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:21.581769 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls podName:768f3d5e-e7d7-4b02-90b2-9e2afd19aa79 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:29.581748666 +0000 UTC m=+77.452183841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dz8tt" (UID: "768f3d5e-e7d7-4b02-90b2-9e2afd19aa79") : secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:21.864078 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:21.864036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:22.004102 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.004065 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:22.074974 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.074933 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:22.704282 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.704241 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:22.712819 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.712787 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x"] Jul 14 01:00:22.734714 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.734682 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x"] Jul 14 01:00:22.734872 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.734768 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" Jul 14 01:00:22.737292 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.737261 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 01:00:22.738472 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.738443 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z8kc7\"" Jul 14 01:00:22.738729 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.738710 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 01:00:22.791531 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.791498 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5cj2\" (UniqueName: \"kubernetes.io/projected/d394b87a-9aa0-4f72-9db6-346ee5ff912e-kube-api-access-g5cj2\") pod \"migrator-7f59b54f6c-pb29x\" (UID: \"d394b87a-9aa0-4f72-9db6-346ee5ff912e\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" Jul 14 01:00:22.794232 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.794200 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:22.892151 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.892111 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5cj2\" (UniqueName: \"kubernetes.io/projected/d394b87a-9aa0-4f72-9db6-346ee5ff912e-kube-api-access-g5cj2\") pod \"migrator-7f59b54f6c-pb29x\" (UID: \"d394b87a-9aa0-4f72-9db6-346ee5ff912e\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" Jul 14 01:00:22.895175 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.895144 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:22.899532 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.899501 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5cj2\" (UniqueName: \"kubernetes.io/projected/d394b87a-9aa0-4f72-9db6-346ee5ff912e-kube-api-access-g5cj2\") pod \"migrator-7f59b54f6c-pb29x\" (UID: \"d394b87a-9aa0-4f72-9db6-346ee5ff912e\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" Jul 14 01:00:22.995234 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:22.995150 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:23.047046 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.046961 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:23.050505 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.050477 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" Jul 14 01:00:23.296171 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.296098 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-stwbb"] Jul 14 01:00:23.310177 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.310142 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:23.313751 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.313724 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stwbb"] Jul 14 01:00:23.313887 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.313845 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.316235 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.316211 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 01:00:23.316377 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.316238 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 01:00:23.316444 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.316405 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 01:00:23.317237 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.317205 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 01:00:23.317344 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.317247 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zmdxs\"" Jul 14 01:00:23.379955 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.379892 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:23.395973 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.395939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-data-volume\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.396143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.395986 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.396143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.396053 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.396143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.396082 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-crio-socket\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.396267 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.396229 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdbkn\" (UniqueName: \"kubernetes.io/projected/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-api-access-xdbkn\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.497248 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.497208 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.497432 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.497257 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-crio-socket\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.497432 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.497324 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdbkn\" (UniqueName: \"kubernetes.io/projected/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-api-access-xdbkn\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.497432 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:23.497341 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 01:00:23.497432 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:23.497412 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:23.997394483 +0000 UTC m=+71.867829652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : configmap "kube-rbac-proxy" not found Jul 14 01:00:23.497432 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.497423 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-crio-socket\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.497690 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.497484 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-data-volume\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.497690 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.497517 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.497690 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:23.497618 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 01:00:23.497690 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:23.497654 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:23.997642714 +0000 UTC m=+71.868077883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : secret "insights-runtime-extractor-tls" not found Jul 14 01:00:23.497883 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.497867 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-data-volume\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.505605 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.505580 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdbkn\" (UniqueName: \"kubernetes.io/projected/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-api-access-xdbkn\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:23.717804 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.717780 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:23.796157 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.796133 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x"] Jul 14 01:00:23.799510 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:23.799476 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd394b87a_9aa0_4f72_9db6_346ee5ff912e.slice/crio-7cfa9fd0c49883fdabc56141a8bb66a33c12648788d91245812affcf46f48803 WatchSource:0}: Error finding container 7cfa9fd0c49883fdabc56141a8bb66a33c12648788d91245812affcf46f48803: Status 404 returned error can't find the container with id 7cfa9fd0c49883fdabc56141a8bb66a33c12648788d91245812affcf46f48803 Jul 14 01:00:23.801068 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.801042 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:23.893836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.893803 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:23.940961 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.940930 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2462s" event={"ID":"ca916d41-8ccd-4a52-afa1-d11d4879461d","Type":"ContainerStarted","Data":"84810acc9426124060082aa2b09cdb7d32dfd672a5d8c13c9af37823ba4cff95"} Jul 14 01:00:23.941123 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.941017 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 01:00:23.942554 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.942529 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22rf5" event={"ID":"59c02ce8-6473-4e18-a8d1-f762e45ea446","Type":"ContainerStarted","Data":"927946aef0f0d0604c5ac5455f70a305b474f5385a34ee6ea72cc3f67a7eb4e7"} Jul 14 01:00:23.943540 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.943520 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" event={"ID":"d394b87a-9aa0-4f72-9db6-346ee5ff912e","Type":"ContainerStarted","Data":"7cfa9fd0c49883fdabc56141a8bb66a33c12648788d91245812affcf46f48803"} Jul 14 01:00:23.958894 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.958841 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2462s" podStartSLOduration=66.100859838 podStartE2EDuration="1m10.958824209s" totalImagesPullingTime="4.857964371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:23.958525916 +0000 UTC m=+71.828961134" watchObservedRunningTime="2026-07-14 01:00:23.958824209 +0000 UTC m=+71.829259405" Jul 14 01:00:23.976721 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.976673 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-22rf5" podStartSLOduration=65.78843882 podStartE2EDuration="1m10.976658824s" totalImagesPullingTime="5.188220004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:23.976020116 +0000 UTC m=+71.846455319" watchObservedRunningTime="2026-07-14 01:00:23.976658824 +0000 UTC m=+71.847094015" Jul 14 01:00:23.993384 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:23.993355 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:24.000447 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:24.000415 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:24.000569 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:24.000522 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 01:00:24.000635 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:24.000575 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:24.000685 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:24.000648 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:25.000629014 +0000 UTC m=+72.871064210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : secret "insights-runtime-extractor-tls" not found Jul 14 01:00:24.000733 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:24.000681 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 01:00:24.000733 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:24.000728 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:25.00071494 +0000 UTC m=+72.871150151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : configmap "kube-rbac-proxy" not found Jul 14 01:00:24.091880 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:24.091838 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:25.009223 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:25.009177 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:25.009716 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:25.009270 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:25.009716 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:25.009391 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 01:00:25.009716 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:25.009465 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:27.00944434 +0000 UTC m=+74.879879512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : secret "insights-runtime-extractor-tls" not found Jul 14 01:00:25.009716 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:25.009527 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 01:00:25.009716 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:25.009599 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:27.009581238 +0000 UTC m=+74.880016420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : configmap "kube-rbac-proxy" not found Jul 14 01:00:25.622708 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:25.622674 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:25.721293 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:25.721246 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:25.888953 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:25.888852 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stvd5_153c1406-f910-420b-b32b-0e191ae821b8/dns-node-resolver/0.log" Jul 14 01:00:25.949828 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:25.949795 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" event={"ID":"d394b87a-9aa0-4f72-9db6-346ee5ff912e","Type":"ContainerStarted","Data":"210e76d2ec017e428c0a54b62d54937cc13231d53282f2dc2759b97238f98c13"} Jul 14 01:00:25.949993 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:25.949877 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" event={"ID":"d394b87a-9aa0-4f72-9db6-346ee5ff912e","Type":"ContainerStarted","Data":"01be13023bcfc222fbe6c21b455f902d81eb935555f0fc1c568bba24a3d24969"} Jul 14 01:00:25.962509 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:25.962457 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pb29x" podStartSLOduration=2.287556771 podStartE2EDuration="3.962441584s" totalImagesPullingTime="1.674884813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:25.961768692 +0000 UTC m=+73.832203883" watchObservedRunningTime="2026-07-14 01:00:25.962441584 +0000 UTC m=+73.832876775" Jul 14 01:00:26.029300 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:26.029265 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:26.451475 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:26.451434 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:26.689151 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:26.689125 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tsm4n_3821f29d-fce5-49ab-90ab-3cdd607117f8/node-ca/0.log" Jul 14 01:00:27.028230 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:27.028183 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:27.028400 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:27.028271 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:27.028400 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:27.028360 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 01:00:27.028400 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:27.028387 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 01:00:27.028518 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:27.028424 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:31.028406423 +0000 UTC m=+78.898841613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : secret "insights-runtime-extractor-tls" not found Jul 14 01:00:27.028518 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:27.028446 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:31.028432 +0000 UTC m=+78.898867169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : configmap "kube-rbac-proxy" not found Jul 14 01:00:27.290748 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:27.290669 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2d26n_a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc/serve-healthcheck-canary/0.log" Jul 14 01:00:27.457402 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:27.457340 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:27.634600 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:27.634502 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:27.691157 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:27.691125 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pb29x_d394b87a-9aa0-4f72-9db6-346ee5ff912e/migrator/0.log" Jul 14 01:00:27.892519 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:27.892429 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pb29x_d394b87a-9aa0-4f72-9db6-346ee5ff912e/graceful-termination/0.log" Jul 14 01:00:28.081364 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:28.081328 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:28.150315 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:28.150229 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:28.251326 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:28.251292 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:28.990051 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:28.989993 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:29.161374 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:29.161339 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:29.445764 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:29.445730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:29.445947 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:29.445881 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 01:00:29.445999 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:29.445964 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert podName:1d7d8424-4118-4a20-877a-8f109a1328ce nodeName:}" failed. No retries permitted until 2026-07-14 01:00:45.445948627 +0000 UTC m=+93.316383797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5g8st" (UID: "1d7d8424-4118-4a20-877a-8f109a1328ce") : secret "networking-console-plugin-cert" not found Jul 14 01:00:29.546600 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:29.546552 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:29.546793 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:29.546652 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:29.546793 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:29.546707 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:45.546690741 +0000 UTC m=+93.417125911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : configmap references non-existent config key: service-ca.crt Jul 14 01:00:29.546793 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:29.546767 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 01:00:29.546956 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:29.546823 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs podName:6d2d685e-55ee-4bf4-8bf4-eebecf331634 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:45.546809357 +0000 UTC m=+93.417244548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs") pod "router-default-8fbcfbfcd-rwqtd" (UID: "6d2d685e-55ee-4bf4-8bf4-eebecf331634") : secret "router-metrics-certs-default" not found Jul 14 01:00:29.558393 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:29.558368 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:29.647301 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:29.647269 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:29.647463 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:29.647430 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:29.647508 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:29.647497 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls podName:768f3d5e-e7d7-4b02-90b2-9e2afd19aa79 nodeName:}" failed. No retries permitted until 2026-07-14 01:00:45.647480984 +0000 UTC m=+93.517916153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dz8tt" (UID: "768f3d5e-e7d7-4b02-90b2-9e2afd19aa79") : secret "cluster-monitoring-operator-tls" not found Jul 14 01:00:29.778865 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:29.778773 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:29.960298 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:29.960263 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:30.370358 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:30.370317 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:30.756413 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:30.756373 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:31.061041 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:31.060951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:31.061041 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:31.061023 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:31.061219 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:31.061114 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 01:00:31.061219 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:31.061150 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 01:00:31.061219 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:31.061183 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:39.061168618 +0000 UTC m=+86.931603786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : secret "insights-runtime-extractor-tls" not found Jul 14 01:00:31.061219 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:00:31.061216 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm podName:c66cfe50-96d7-4ba5-8704-d21a5a02fa9a nodeName:}" failed. No retries permitted until 2026-07-14 01:00:39.061200933 +0000 UTC m=+86.931636103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stwbb" (UID: "c66cfe50-96d7-4ba5-8704-d21a5a02fa9a") : configmap "kube-rbac-proxy" not found Jul 14 01:00:31.154343 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:31.154311 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:31.270482 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:31.270445 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:31.564165 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:31.564123 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:31.798076 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:31.798038 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:32.162073 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:32.162036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:32.357634 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:32.357597 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:32.762379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:32.762342 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:33.157041 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:33.156952 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:33.387933 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:33.387874 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:33.738984 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:33.738834 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:33.838960 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:33.838926 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:34.157706 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:34.157617 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:34.556775 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:34.556735 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:34.996252 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:34.996214 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:35.352749 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:35.352667 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:35.756927 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:35.756879 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:35.857036 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:35.856994 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:35.974183 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:35.974147 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:36.355939 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:36.355892 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:37.164539 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:37.164503 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:37.355400 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:37.355331 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:37.759546 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:37.759490 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:37.962370 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:37.962330 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:38.159167 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:38.159076 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:39.127850 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:39.127812 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:39.128227 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:39.127873 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:39.128433 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:39.128411 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:39.130188 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:39.130170 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c66cfe50-96d7-4ba5-8704-d21a5a02fa9a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stwbb\" (UID: \"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a\") " pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:39.225673 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:39.225634 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stwbb" Jul 14 01:00:39.353111 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:39.353086 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stwbb"] Jul 14 01:00:39.355200 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:39.355178 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66cfe50_96d7_4ba5_8704_d21a5a02fa9a.slice/crio-11b37da93fecb0ba1ae29b9c79066ccb00eaeefe5e1382b531fb42f0149aa23c WatchSource:0}: Error finding container 11b37da93fecb0ba1ae29b9c79066ccb00eaeefe5e1382b531fb42f0149aa23c: Status 404 returned error can't find the container with id 11b37da93fecb0ba1ae29b9c79066ccb00eaeefe5e1382b531fb42f0149aa23c Jul 14 01:00:39.988593 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:39.988554 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stwbb" event={"ID":"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a","Type":"ContainerStarted","Data":"11b37da93fecb0ba1ae29b9c79066ccb00eaeefe5e1382b531fb42f0149aa23c"} Jul 14 01:00:41.013008 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:41.012962 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:41.115078 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:41.115042 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:41.302938 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:41.302833 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:41.491760 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:41.491723 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:41.680252 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:41.680217 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:42.081423 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:42.081336 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:42.182443 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:42.182410 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:42.283833 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:42.283796 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:42.513846 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:42.513806 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:42.913958 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:42.913863 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:42.962986 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:42.962940 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:43.095905 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:43.095880 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:43.297349 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:43.297299 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:44.001396 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:44.001363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stwbb" event={"ID":"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a","Type":"ContainerStarted","Data":"bea316dd1394c592e1092fa058b8bb6e2d79538a5657fd441b0a350a81a3f322"} Jul 14 01:00:45.007068 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.007030 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stwbb" event={"ID":"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a","Type":"ContainerStarted","Data":"1ad57e48ac82ec03262dae16054fb251f97dcdaa5d02f05d842002cb6c06f9c0"} Jul 14 01:00:45.111711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.111673 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:45.489127 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.489081 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:45.491899 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.491862 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d7d8424-4118-4a20-877a-8f109a1328ce-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5g8st\" (UID: \"1d7d8424-4118-4a20-877a-8f109a1328ce\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:45.499622 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.499595 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" Jul 14 01:00:45.590301 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.589805 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:45.590301 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.589881 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:45.591956 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.591904 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d2d685e-55ee-4bf4-8bf4-eebecf331634-service-ca-bundle\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:45.593154 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.593129 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d2d685e-55ee-4bf4-8bf4-eebecf331634-metrics-certs\") pod \"router-default-8fbcfbfcd-rwqtd\" (UID: \"6d2d685e-55ee-4bf4-8bf4-eebecf331634\") " pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:45.638631 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.638583 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-5g8st"] Jul 14 01:00:45.641491 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:45.641447 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7d8424_4118_4a20_877a_8f109a1328ce.slice/crio-1376459a4717905daa7c400ae9d59a87e02f096e52da9a4a5844d0b148911465 WatchSource:0}: Error finding container 1376459a4717905daa7c400ae9d59a87e02f096e52da9a4a5844d0b148911465: Status 404 returned error can't find the container with id 1376459a4717905daa7c400ae9d59a87e02f096e52da9a4a5844d0b148911465 Jul 14 01:00:45.690630 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.690583 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:45.693260 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.693237 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/768f3d5e-e7d7-4b02-90b2-9e2afd19aa79-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dz8tt\" (UID: \"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:45.890487 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.890406 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:45.988797 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:45.988759 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" Jul 14 01:00:46.012567 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:46.012528 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" event={"ID":"1d7d8424-4118-4a20-877a-8f109a1328ce","Type":"ContainerStarted","Data":"1376459a4717905daa7c400ae9d59a87e02f096e52da9a4a5844d0b148911465"} Jul 14 01:00:47.013736 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.013710 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8fbcfbfcd-rwqtd"] Jul 14 01:00:47.016935 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:47.016891 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2d685e_55ee_4bf4_8bf4_eebecf331634.slice/crio-bd7b0311e68971e6ead208fb5782d30ff3d3127d671ae17d53215524a53e226e WatchSource:0}: Error finding container bd7b0311e68971e6ead208fb5782d30ff3d3127d671ae17d53215524a53e226e: Status 404 returned error can't find the container with id bd7b0311e68971e6ead208fb5782d30ff3d3127d671ae17d53215524a53e226e Jul 14 01:00:47.027326 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.027295 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt"] Jul 14 01:00:47.031649 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:47.031628 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768f3d5e_e7d7_4b02_90b2_9e2afd19aa79.slice/crio-84200042196f26ef88cbba1897299fe2b3503e378232161be4f6d71838d3b940 WatchSource:0}: Error finding container 84200042196f26ef88cbba1897299fe2b3503e378232161be4f6d71838d3b940: Status 404 returned error can't find the container with id 84200042196f26ef88cbba1897299fe2b3503e378232161be4f6d71838d3b940 Jul 14 01:00:47.416497 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.416464 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq"] Jul 14 01:00:47.419344 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.419327 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp"] Jul 14 01:00:47.419467 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.419447 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" Jul 14 01:00:47.422158 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.422137 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.423702 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.423667 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 01:00:47.423792 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.423743 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 01:00:47.423792 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.423743 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 01:00:47.424190 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.424177 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 01:00:47.424800 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.424782 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 14 01:00:47.424949 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.424909 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-k42mj\"" Jul 14 01:00:47.430360 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.430336 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq"] Jul 14 01:00:47.431017 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.430998 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp"] Jul 14 01:00:47.459495 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.459468 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-c2j9q"] Jul 14 01:00:47.462700 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.462668 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-c2j9q" Jul 14 01:00:47.467062 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.466047 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 01:00:47.467062 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.466104 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 01:00:47.467062 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.466319 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cnnbv\"" Jul 14 01:00:47.473533 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.473506 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-c2j9q"] Jul 14 01:00:47.549310 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.549280 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:47.606047 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.606007 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q8vj\" (UniqueName: \"kubernetes.io/projected/89e2bf17-d1ce-4a34-badd-8a73ed96ecd6-kube-api-access-8q8vj\") pod \"managed-serviceaccount-addon-agent-867d6659fd-cb4vq\" (UID: \"89e2bf17-d1ce-4a34-badd-8a73ed96ecd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" Jul 14 01:00:47.606204 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.606060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89e2bf17-d1ce-4a34-badd-8a73ed96ecd6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-867d6659fd-cb4vq\" (UID: \"89e2bf17-d1ce-4a34-badd-8a73ed96ecd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" Jul 14 01:00:47.606204 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.606130 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt2rx\" (UniqueName: \"kubernetes.io/projected/91bb1b98-662f-4705-885c-67541f848dbd-kube-api-access-rt2rx\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.606366 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.606203 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lt2r\" (UniqueName: \"kubernetes.io/projected/afb48f9a-79b4-4ac8-90af-0acfd5459fc0-kube-api-access-8lt2r\") pod \"downloads-68c9cbb497-c2j9q\" (UID: \"afb48f9a-79b4-4ac8-90af-0acfd5459fc0\") " pod="openshift-console/downloads-68c9cbb497-c2j9q" Jul 14 01:00:47.606366 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.606231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bb1b98-662f-4705-885c-67541f848dbd-tmp\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.606366 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.606351 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91bb1b98-662f-4705-885c-67541f848dbd-klusterlet-config\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.646218 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.646183 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:47.707152 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.707058 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lt2r\" (UniqueName: \"kubernetes.io/projected/afb48f9a-79b4-4ac8-90af-0acfd5459fc0-kube-api-access-8lt2r\") pod \"downloads-68c9cbb497-c2j9q\" (UID: \"afb48f9a-79b4-4ac8-90af-0acfd5459fc0\") " pod="openshift-console/downloads-68c9cbb497-c2j9q" Jul 14 01:00:47.707152 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.707104 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bb1b98-662f-4705-885c-67541f848dbd-tmp\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.707371 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.707181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91bb1b98-662f-4705-885c-67541f848dbd-klusterlet-config\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.707371 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.707239 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q8vj\" (UniqueName: \"kubernetes.io/projected/89e2bf17-d1ce-4a34-badd-8a73ed96ecd6-kube-api-access-8q8vj\") pod \"managed-serviceaccount-addon-agent-867d6659fd-cb4vq\" (UID: \"89e2bf17-d1ce-4a34-badd-8a73ed96ecd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" Jul 14 01:00:47.707371 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.707266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89e2bf17-d1ce-4a34-badd-8a73ed96ecd6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-867d6659fd-cb4vq\" (UID: \"89e2bf17-d1ce-4a34-badd-8a73ed96ecd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" Jul 14 01:00:47.707371 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.707295 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt2rx\" (UniqueName: \"kubernetes.io/projected/91bb1b98-662f-4705-885c-67541f848dbd-kube-api-access-rt2rx\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.708127 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.708096 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bb1b98-662f-4705-885c-67541f848dbd-tmp\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.710317 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.710293 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91bb1b98-662f-4705-885c-67541f848dbd-klusterlet-config\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.710433 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.710378 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89e2bf17-d1ce-4a34-badd-8a73ed96ecd6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-867d6659fd-cb4vq\" (UID: \"89e2bf17-d1ce-4a34-badd-8a73ed96ecd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" Jul 14 01:00:47.718309 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.718284 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt2rx\" (UniqueName: \"kubernetes.io/projected/91bb1b98-662f-4705-885c-67541f848dbd-kube-api-access-rt2rx\") pod \"klusterlet-addon-workmgr-575f9f4bdb-87tbp\" (UID: \"91bb1b98-662f-4705-885c-67541f848dbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.718717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.718694 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lt2r\" (UniqueName: \"kubernetes.io/projected/afb48f9a-79b4-4ac8-90af-0acfd5459fc0-kube-api-access-8lt2r\") pod \"downloads-68c9cbb497-c2j9q\" (UID: \"afb48f9a-79b4-4ac8-90af-0acfd5459fc0\") " pod="openshift-console/downloads-68c9cbb497-c2j9q" Jul 14 01:00:47.718865 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.718844 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q8vj\" (UniqueName: \"kubernetes.io/projected/89e2bf17-d1ce-4a34-badd-8a73ed96ecd6-kube-api-access-8q8vj\") pod \"managed-serviceaccount-addon-agent-867d6659fd-cb4vq\" (UID: \"89e2bf17-d1ce-4a34-badd-8a73ed96ecd6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" Jul 14 01:00:47.739758 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.739722 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" Jul 14 01:00:47.745883 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.745862 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:47.747758 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.747730 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:47.775229 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.775195 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-c2j9q" Jul 14 01:00:47.846146 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.846108 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:47.983776 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:47.983719 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-c2j9q"] Jul 14 01:00:47.988125 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:47.988084 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb48f9a_79b4_4ac8_90af_0acfd5459fc0.slice/crio-808194df84832822b612c45ef1bfbfc048dcec332d58d142be58cf8d1fa8f1f3 WatchSource:0}: Error finding container 808194df84832822b612c45ef1bfbfc048dcec332d58d142be58cf8d1fa8f1f3: Status 404 returned error can't find the container with id 808194df84832822b612c45ef1bfbfc048dcec332d58d142be58cf8d1fa8f1f3 Jul 14 01:00:48.006027 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.005961 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq"] Jul 14 01:00:48.006996 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.006975 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp"] Jul 14 01:00:48.009704 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:48.009668 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89e2bf17_d1ce_4a34_badd_8a73ed96ecd6.slice/crio-467c57448cdc98af74c5b827abeb0dc1814f402cf4c7ee46325cc4e1ad214b47 WatchSource:0}: Error finding container 467c57448cdc98af74c5b827abeb0dc1814f402cf4c7ee46325cc4e1ad214b47: Status 404 returned error can't find the container with id 467c57448cdc98af74c5b827abeb0dc1814f402cf4c7ee46325cc4e1ad214b47 Jul 14 01:00:48.010229 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:48.010190 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bb1b98_662f_4705_885c_67541f848dbd.slice/crio-b45411d90b3861a00e84c1ab9ff42b44901541b8ffb783407d73062e9d818719 WatchSource:0}: Error finding container b45411d90b3861a00e84c1ab9ff42b44901541b8ffb783407d73062e9d818719: Status 404 returned error can't find the container with id b45411d90b3861a00e84c1ab9ff42b44901541b8ffb783407d73062e9d818719 Jul 14 01:00:48.020291 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.020265 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-c2j9q" event={"ID":"afb48f9a-79b4-4ac8-90af-0acfd5459fc0","Type":"ContainerStarted","Data":"808194df84832822b612c45ef1bfbfc048dcec332d58d142be58cf8d1fa8f1f3"} Jul 14 01:00:48.021308 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.021285 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" event={"ID":"89e2bf17-d1ce-4a34-badd-8a73ed96ecd6","Type":"ContainerStarted","Data":"467c57448cdc98af74c5b827abeb0dc1814f402cf4c7ee46325cc4e1ad214b47"} Jul 14 01:00:48.022328 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.022293 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" event={"ID":"91bb1b98-662f-4705-885c-67541f848dbd","Type":"ContainerStarted","Data":"b45411d90b3861a00e84c1ab9ff42b44901541b8ffb783407d73062e9d818719"} Jul 14 01:00:48.024377 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.024333 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stwbb" event={"ID":"c66cfe50-96d7-4ba5-8704-d21a5a02fa9a","Type":"ContainerStarted","Data":"1260b7b176fc5c2d40bc3852128cece3de0b59d57f4dc73114aee8bd2ee57eba"} Jul 14 01:00:48.025814 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.025791 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" event={"ID":"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79","Type":"ContainerStarted","Data":"84200042196f26ef88cbba1897299fe2b3503e378232161be4f6d71838d3b940"} Jul 14 01:00:48.027287 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.027258 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" event={"ID":"1d7d8424-4118-4a20-877a-8f109a1328ce","Type":"ContainerStarted","Data":"76a681aa5cc1f04d9b209b7fcc6490cfc3b84a1b610f0b4e2848fc32576b3064"} Jul 14 01:00:48.028703 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.028684 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" event={"ID":"6d2d685e-55ee-4bf4-8bf4-eebecf331634","Type":"ContainerStarted","Data":"a502ab49599fb876f252fc9513ca73f524074c3a32fc55b842df96569641f59d"} Jul 14 01:00:48.028785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.028715 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" event={"ID":"6d2d685e-55ee-4bf4-8bf4-eebecf331634","Type":"ContainerStarted","Data":"bd7b0311e68971e6ead208fb5782d30ff3d3127d671ae17d53215524a53e226e"} Jul 14 01:00:48.040135 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.040092 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-stwbb" podStartSLOduration=17.569653048 podStartE2EDuration="25.040079844s" totalImagesPullingTime="7.470426796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:00:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:48.039034539 +0000 UTC m=+95.909469731" watchObservedRunningTime="2026-07-14 01:00:48.040079844 +0000 UTC m=+95.910515034" Jul 14 01:00:48.053054 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.053011 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-5g8st" podStartSLOduration=32.802379267 podStartE2EDuration="35.052997444s" totalImagesPullingTime="2.250618177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:48.052106527 +0000 UTC m=+95.922541731" watchObservedRunningTime="2026-07-14 01:00:48.052997444 +0000 UTC m=+95.923432635" Jul 14 01:00:48.068799 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.068743 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" podStartSLOduration=35.068723178 podStartE2EDuration="35.068723178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:48.068116886 +0000 UTC m=+95.938552094" watchObservedRunningTime="2026-07-14 01:00:48.068723178 +0000 UTC m=+95.939158372" Jul 14 01:00:48.556612 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.556575 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:48.891332 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.891240 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:48.894284 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.894256 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:48.921345 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.921317 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-987fb9fff-qn7g7"] Jul 14 01:00:48.922159 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.922079 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:48.924622 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.924603 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:48.926906 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.926878 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 01:00:48.927218 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.927200 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xt9b8\"" Jul 14 01:00:48.927310 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.927226 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 01:00:48.927455 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.927432 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 01:00:48.927624 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.927611 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 01:00:48.927808 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.927759 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 01:00:48.933281 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:48.933258 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-987fb9fff-qn7g7"] Jul 14 01:00:49.016598 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.016550 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-config\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.016785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.016713 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-serving-cert\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.016785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.016759 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-oauth-config\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.016872 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.016809 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chdk9\" (UniqueName: \"kubernetes.io/projected/9d3aa72b-a17f-4bd1-b225-51c635dc0172-kube-api-access-chdk9\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.016872 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.016847 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-service-ca\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.016872 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.016863 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-oauth-serving-cert\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.019530 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.019498 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:49.036721 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.036695 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:49.038169 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.038146 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8fbcfbfcd-rwqtd" Jul 14 01:00:49.118348 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.118315 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-config\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.118986 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.118966 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-config\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.119097 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.119077 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-serving-cert\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.119224 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.119114 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-oauth-config\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.119224 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.119151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chdk9\" (UniqueName: \"kubernetes.io/projected/9d3aa72b-a17f-4bd1-b225-51c635dc0172-kube-api-access-chdk9\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.119224 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.119210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-service-ca\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.119380 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.119234 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-oauth-serving-cert\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.119974 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.119950 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-oauth-serving-cert\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.120074 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.120025 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-service-ca\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.122437 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.122414 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-serving-cert\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.123597 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.123570 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-oauth-config\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.128007 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.127985 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chdk9\" (UniqueName: \"kubernetes.io/projected/9d3aa72b-a17f-4bd1-b225-51c635dc0172-kube-api-access-chdk9\") pod \"console-987fb9fff-qn7g7\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.235561 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.235530 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:49.564092 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.564066 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-987fb9fff-qn7g7"] Jul 14 01:00:49.567244 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:49.567221 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3aa72b_a17f_4bd1_b225_51c635dc0172.slice/crio-956baab60b3ebecfb8e3c02302bfdceee49b3bde2db29760a83e076f972888ed WatchSource:0}: Error finding container 956baab60b3ebecfb8e3c02302bfdceee49b3bde2db29760a83e076f972888ed: Status 404 returned error can't find the container with id 956baab60b3ebecfb8e3c02302bfdceee49b3bde2db29760a83e076f972888ed Jul 14 01:00:49.836800 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.836689 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:49.938112 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.938077 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:49.992648 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.992610 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g"] Jul 14 01:00:49.999126 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:49.999093 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" Jul 14 01:00:50.002237 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.002212 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 14 01:00:50.002439 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.002342 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hc584\"" Jul 14 01:00:50.002527 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.002491 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g"] Jul 14 01:00:50.010317 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.010288 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:50.040600 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.040568 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" event={"ID":"768f3d5e-e7d7-4b02-90b2-9e2afd19aa79","Type":"ContainerStarted","Data":"089093ab5cdd00a4934bb7adbc3d902543f1e000db4baac16105c4c8b60e8267"} Jul 14 01:00:50.041724 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.041702 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-987fb9fff-qn7g7" event={"ID":"9d3aa72b-a17f-4bd1-b225-51c635dc0172","Type":"ContainerStarted","Data":"956baab60b3ebecfb8e3c02302bfdceee49b3bde2db29760a83e076f972888ed"} Jul 14 01:00:50.055201 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.055149 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dz8tt" podStartSLOduration=34.603962281 podStartE2EDuration="37.055133148s" totalImagesPullingTime="2.451170867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:50.054829404 +0000 UTC m=+97.925264621" watchObservedRunningTime="2026-07-14 01:00:50.055133148 +0000 UTC m=+97.925568343" Jul 14 01:00:50.128466 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.128368 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f6c6d1f-d87b-4dda-8455-52b2882f5838-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-j8n9g\" (UID: \"7f6c6d1f-d87b-4dda-8455-52b2882f5838\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" Jul 14 01:00:50.168899 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.168866 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:50.229952 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.229056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f6c6d1f-d87b-4dda-8455-52b2882f5838-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-j8n9g\" (UID: \"7f6c6d1f-d87b-4dda-8455-52b2882f5838\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" Jul 14 01:00:50.232159 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.232129 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7f6c6d1f-d87b-4dda-8455-52b2882f5838-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-j8n9g\" (UID: \"7f6c6d1f-d87b-4dda-8455-52b2882f5838\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" Jul 14 01:00:50.310085 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.310045 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" Jul 14 01:00:50.465440 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:50.465403 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g"] Jul 14 01:00:50.469711 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:50.469678 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6c6d1f_d87b_4dda_8455_52b2882f5838.slice/crio-353ee32218d3add4718b3f4aaf29e68de80ecffcafc37a1d76ac299fc0ac61ee WatchSource:0}: Error finding container 353ee32218d3add4718b3f4aaf29e68de80ecffcafc37a1d76ac299fc0ac61ee: Status 404 returned error can't find the container with id 353ee32218d3add4718b3f4aaf29e68de80ecffcafc37a1d76ac299fc0ac61ee Jul 14 01:00:51.050943 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:51.050681 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" event={"ID":"7f6c6d1f-d87b-4dda-8455-52b2882f5838","Type":"ContainerStarted","Data":"353ee32218d3add4718b3f4aaf29e68de80ecffcafc37a1d76ac299fc0ac61ee"} Jul 14 01:00:51.847322 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:51.846786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:00:51.875150 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:51.875119 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"image-registry-749c5644cd-mrk7v\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:00:51.947487 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:51.947443 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 01:00:51.960215 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:51.960132 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c771e3b9-fdcf-4ee3-91b1-3bb92e487c71-metrics-tls\") pod \"dns-default-z2s8x\" (UID: \"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71\") " pod="openshift-dns/dns-default-z2s8x" Jul 14 01:00:52.163022 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:52.162928 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gn7kr\"" Jul 14 01:00:52.171536 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:52.171468 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:00:52.180908 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:52.180709 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x8vr9\"" Jul 14 01:00:52.189799 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:52.189541 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z2s8x" Jul 14 01:00:53.620877 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:53.620841 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:54.948562 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:54.948532 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2462s" Jul 14 01:00:55.762506 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:55.762455 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:55.863042 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:55.862874 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:56.362797 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:56.362768 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749c5644cd-mrk7v"] Jul 14 01:00:56.377252 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:56.377185 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z2s8x"] Jul 14 01:00:56.494710 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:56.494671 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0733d9ff_74bf_4f4d_a509_6a659b58d3b6.slice/crio-2ece2d25f25c6515169c00d66711212dd2e87149028290957e7ab5cff78127bc WatchSource:0}: Error finding container 2ece2d25f25c6515169c00d66711212dd2e87149028290957e7ab5cff78127bc: Status 404 returned error can't find the container with id 2ece2d25f25c6515169c00d66711212dd2e87149028290957e7ab5cff78127bc Jul 14 01:00:56.495022 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:00:56.494994 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc771e3b9_fdcf_4ee3_91b1_3bb92e487c71.slice/crio-6a585e227b25982d26e99e05c39319166003ccafd94a3178e3f173ec0d3ce5d7 WatchSource:0}: Error finding container 6a585e227b25982d26e99e05c39319166003ccafd94a3178e3f173ec0d3ce5d7: Status 404 returned error can't find the container with id 6a585e227b25982d26e99e05c39319166003ccafd94a3178e3f173ec0d3ce5d7 Jul 14 01:00:57.080843 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.080785 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" event={"ID":"89e2bf17-d1ce-4a34-badd-8a73ed96ecd6","Type":"ContainerStarted","Data":"38d04d19968090211b4342d5fe2ad89ce9427c4fa1edaac350a5e95849a4c2d8"} Jul 14 01:00:57.084669 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.084636 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" event={"ID":"91bb1b98-662f-4705-885c-67541f848dbd","Type":"ContainerStarted","Data":"3ef72e4e17e20905a22a8176a359640d35478e44614581ee1b856c52f5372722"} Jul 14 01:00:57.086274 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.086236 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:57.087850 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.087809 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" event={"ID":"7f6c6d1f-d87b-4dda-8455-52b2882f5838","Type":"ContainerStarted","Data":"d2612f65882bd4f7758bb7ef3a96c5d4f6d30f9daa7c0050f66e5646921d2a8d"} Jul 14 01:00:57.088941 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.088900 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" Jul 14 01:00:57.089187 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.089139 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" Jul 14 01:00:57.091945 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.091827 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" event={"ID":"0733d9ff-74bf-4f4d-a509-6a659b58d3b6","Type":"ContainerStarted","Data":"74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69"} Jul 14 01:00:57.091945 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.091870 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" event={"ID":"0733d9ff-74bf-4f4d-a509-6a659b58d3b6","Type":"ContainerStarted","Data":"2ece2d25f25c6515169c00d66711212dd2e87149028290957e7ab5cff78127bc"} Jul 14 01:00:57.092335 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.092157 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:00:57.093667 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.093631 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z2s8x" event={"ID":"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71","Type":"ContainerStarted","Data":"6a585e227b25982d26e99e05c39319166003ccafd94a3178e3f173ec0d3ce5d7"} Jul 14 01:00:57.096690 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.096651 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" Jul 14 01:00:57.098110 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.097484 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-987fb9fff-qn7g7" event={"ID":"9d3aa72b-a17f-4bd1-b225-51c635dc0172","Type":"ContainerStarted","Data":"d1c1fe7d2c2c83ed1de94d2481d7f7102ab8c71d4cd81ad1f70e991919e1b2db"} Jul 14 01:00:57.098383 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.098348 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-867d6659fd-cb4vq" podStartSLOduration=1.894953178 podStartE2EDuration="10.09833405s" totalImagesPullingTime="8.203380872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:57.096438825 +0000 UTC m=+104.966874017" watchObservedRunningTime="2026-07-14 01:00:57.09833405 +0000 UTC m=+104.968769240" Jul 14 01:00:57.120157 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.120109 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" podStartSLOduration=104.120095763 podStartE2EDuration="1m44.120095763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:57.118701446 +0000 UTC m=+104.989136664" watchObservedRunningTime="2026-07-14 01:00:57.120095763 +0000 UTC m=+104.990530951" Jul 14 01:00:57.151038 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.150844 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-j8n9g" podStartSLOduration=2.418289018 podStartE2EDuration="8.150823912s" totalImagesPullingTime="5.732534894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:57.150796862 +0000 UTC m=+105.021232070" watchObservedRunningTime="2026-07-14 01:00:57.150823912 +0000 UTC m=+105.021259102" Jul 14 01:00:57.151929 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.151869 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-575f9f4bdb-87tbp" podStartSLOduration=1.6373991509999999 podStartE2EDuration="10.151856201s" totalImagesPullingTime="8.51445705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:57.136715222 +0000 UTC m=+105.007150415" watchObservedRunningTime="2026-07-14 01:00:57.151856201 +0000 UTC m=+105.022291394" Jul 14 01:00:57.168987 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.168843 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-987fb9fff-qn7g7" podStartSLOduration=2.534348344 podStartE2EDuration="9.168822438s" totalImagesPullingTime="6.634474094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:57.168165778 +0000 UTC m=+105.038600993" watchObservedRunningTime="2026-07-14 01:00:57.168822438 +0000 UTC m=+105.039257629" Jul 14 01:00:57.915711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.915662 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:57.967570 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:57.967527 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:58.022801 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:58.022770 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:58.084731 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:58.084685 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:58.620887 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:58.620851 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:00:59.107393 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:59.107357 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z2s8x" event={"ID":"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71","Type":"ContainerStarted","Data":"161b56d90203572a272ccb642e5dc35d6e8093c638f22a0a75cbbdf2ab2ae0e5"} Jul 14 01:00:59.107851 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:59.107430 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z2s8x" Jul 14 01:00:59.107851 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:59.107450 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z2s8x" event={"ID":"c771e3b9-fdcf-4ee3-91b1-3bb92e487c71","Type":"ContainerStarted","Data":"49012e7be30ae4e86cd650d5d7f36be1bb04896891cd7eb9903f3da59bdbd7ab"} Jul 14 01:00:59.124000 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:59.123957 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z2s8x" podStartSLOduration=69.951024796 podStartE2EDuration="1m12.123941347s" totalImagesPullingTime="2.172916551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:00:59.121940873 +0000 UTC m=+106.992376066" watchObservedRunningTime="2026-07-14 01:00:59.123941347 +0000 UTC m=+106.994376538" Jul 14 01:00:59.235876 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:59.235844 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:59.236058 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:59.235905 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:59.242171 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:59.242136 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:00:59.967840 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:00:59.967807 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:00.086958 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:00.086881 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:00.114603 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:00.114574 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:01:03.396617 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:03.396574 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:03.913217 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:03.913175 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:03.965140 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:03.965110 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:04.297945 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:04.297894 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:05.003390 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.003354 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:05.145072 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.145026 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:05.316814 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.316721 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:05.419350 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.419319 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tn7t4"] Jul 14 01:01:05.423110 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.423083 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.426151 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.425802 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fhkh5\"" Jul 14 01:01:05.426151 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.426002 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 01:01:05.426321 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.426202 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 01:01:05.426321 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.426263 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 01:01:05.426782 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.426761 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 01:01:05.460761 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.460730 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-root\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.460939 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.460783 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-sys\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.460939 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.460827 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-textfile\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.460939 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.460850 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-tls\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.460939 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.460872 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/573f36fc-1962-4bd3-b123-517295f8e312-metrics-client-ca\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.460939 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.460937 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b5r8\" (UniqueName: \"kubernetes.io/projected/573f36fc-1962-4bd3-b123-517295f8e312-kube-api-access-7b5r8\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.461189 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.460974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-accelerators-collector-config\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.461189 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.461003 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.461189 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.461050 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-wtmp\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.538483 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.538449 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:05.562237 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562190 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-accelerators-collector-config\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562237 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562239 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562469 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562324 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-wtmp\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562469 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562410 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-root\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562469 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562459 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-sys\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562630 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-textfile\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562630 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562533 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-tls\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562630 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562546 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-wtmp\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562630 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562557 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/573f36fc-1962-4bd3-b123-517295f8e312-metrics-client-ca\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562630 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562604 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b5r8\" (UniqueName: \"kubernetes.io/projected/573f36fc-1962-4bd3-b123-517295f8e312-kube-api-access-7b5r8\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562872 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562678 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-sys\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562872 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562728 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/573f36fc-1962-4bd3-b123-517295f8e312-root\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.562872 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:01:05.562867 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 01:01:05.563055 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:01:05.562954 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-tls podName:573f36fc-1962-4bd3-b123-517295f8e312 nodeName:}" failed. No retries permitted until 2026-07-14 01:01:06.062932758 +0000 UTC m=+113.933367942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-tls") pod "node-exporter-tn7t4" (UID: "573f36fc-1962-4bd3-b123-517295f8e312") : secret "node-exporter-tls" not found Jul 14 01:01:05.563055 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.562982 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-accelerators-collector-config\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.563055 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.563017 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-textfile\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.563539 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.563513 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/573f36fc-1962-4bd3-b123-517295f8e312-metrics-client-ca\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.565027 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.565003 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.571860 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.571795 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b5r8\" (UniqueName: \"kubernetes.io/projected/573f36fc-1962-4bd3-b123-517295f8e312-kube-api-access-7b5r8\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:05.638831 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.638792 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:05.696368 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.696327 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:05.754728 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.754676 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:05.859970 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:05.859864 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:06.031457 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:06.031417 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:06.066854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:06.066824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-tls\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:06.070441 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:06.069830 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/573f36fc-1962-4bd3-b123-517295f8e312-node-exporter-tls\") pod \"node-exporter-tn7t4\" (UID: \"573f36fc-1962-4bd3-b123-517295f8e312\") " pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:06.337498 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:06.337462 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tn7t4" Jul 14 01:01:06.389229 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:06.389187 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:06.489614 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:06.489531 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:06.703737 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:06.703705 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:07.009568 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:07.009485 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:08.041173 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:08.041144 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-987fb9fff-qn7g7"] Jul 14 01:01:08.148694 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:08.148657 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:08.255132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:08.255088 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:08.401414 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:08.401327 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:08.480967 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:08.480905 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:08.535004 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:08.534967 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:08.588279 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:08.588248 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:09.113806 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:09.113773 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z2s8x" Jul 14 01:01:10.230592 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:10.230512 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:10.259222 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:10.259195 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-749c5644cd-mrk7v"] Jul 14 01:01:10.324276 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:10.324245 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:10.424377 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:10.424345 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:10.514937 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:10.514835 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:10.741715 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:10.741661 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:11.650522 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:11.650480 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:12.210065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:12.210036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:12.264455 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:12.264421 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:12.351518 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:01:12.351485 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573f36fc_1962_4bd3_b123_517295f8e312.slice/crio-793682c9b59e142b0a3849ced8621c0464c286792cf22d208f34392ab351bc94 WatchSource:0}: Error finding container 793682c9b59e142b0a3849ced8621c0464c286792cf22d208f34392ab351bc94: Status 404 returned error can't find the container with id 793682c9b59e142b0a3849ced8621c0464c286792cf22d208f34392ab351bc94 Jul 14 01:01:13.176950 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:13.176368 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-c2j9q" event={"ID":"afb48f9a-79b4-4ac8-90af-0acfd5459fc0","Type":"ContainerStarted","Data":"9b5045a4e59ccd09b28c80f92c945067c259b84937daed070ce73c7ee2d93800"} Jul 14 01:01:13.177404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:13.177133 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-c2j9q" Jul 14 01:01:13.178941 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:13.178897 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tn7t4" event={"ID":"573f36fc-1962-4bd3-b123-517295f8e312","Type":"ContainerStarted","Data":"793682c9b59e142b0a3849ced8621c0464c286792cf22d208f34392ab351bc94"} Jul 14 01:01:13.186958 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:13.186896 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-c2j9q" Jul 14 01:01:13.199448 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:13.199403 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-c2j9q" podStartSLOduration=1.504514945 podStartE2EDuration="26.19938836s" totalImagesPullingTime="24.694873415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:01:13.196328685 +0000 UTC m=+121.066763897" watchObservedRunningTime="2026-07-14 01:01:13.19938836 +0000 UTC m=+121.069823551" Jul 14 01:01:13.949982 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:13.949938 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:14.004964 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:14.004909 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:14.185218 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:14.185178 2570 generic.go:356] "Generic (PLEG): container finished" podID="573f36fc-1962-4bd3-b123-517295f8e312" containerID="454f991cfc218941a03f2d0c038f62989e28f6acf8f438537cb8f6e8b358a736" exitCode=0 Jul 14 01:01:14.185713 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:14.185273 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tn7t4" event={"ID":"573f36fc-1962-4bd3-b123-517295f8e312","Type":"ContainerDied","Data":"454f991cfc218941a03f2d0c038f62989e28f6acf8f438537cb8f6e8b358a736"} Jul 14 01:01:15.196211 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:15.196170 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tn7t4" event={"ID":"573f36fc-1962-4bd3-b123-517295f8e312","Type":"ContainerStarted","Data":"2575893f9c9de8fff39d9ac8a2d89cc2f009d85fa358cee5439140ef24beb5af"} Jul 14 01:01:15.196674 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:15.196234 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tn7t4" event={"ID":"573f36fc-1962-4bd3-b123-517295f8e312","Type":"ContainerStarted","Data":"668f2be63ff8e775b4315dc7b35cc57101378399f18db27c5f56844d650dafbe"} Jul 14 01:01:15.214517 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:15.214461 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tn7t4" podStartSLOduration=9.225086463 podStartE2EDuration="10.21444383s" totalImagesPullingTime="904.719245ms" totalInitContainerRuntime="84.638122ms" isStatefulPod=true podCreationTimestamp="2026-07-14 01:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:01:15.212553564 +0000 UTC m=+123.082988754" watchObservedRunningTime="2026-07-14 01:01:15.21444383 +0000 UTC m=+123.084879032" Jul 14 01:01:15.778614 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:15.778571 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:15.879737 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:15.879685 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:18.220717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:18.220675 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:18.272537 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:18.272498 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:19.138847 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:19.138802 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:19.241976 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:19.241883 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:20.266061 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:20.266030 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:01:21.334707 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:21.334669 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:21.433208 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:21.433173 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:22.412016 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:22.411978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 01:01:22.414409 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:22.414392 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eb58e6e-5b22-467f-8725-65881c70b0b9-metrics-certs\") pod \"network-metrics-daemon-5vn5k\" (UID: \"1eb58e6e-5b22-467f-8725-65881c70b0b9\") " pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 01:01:22.573454 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:22.573423 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hm62n\"" Jul 14 01:01:22.581515 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:22.581492 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vn5k" Jul 14 01:01:22.749893 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:22.749864 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vn5k"] Jul 14 01:01:22.753298 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:01:22.753268 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb58e6e_5b22_467f_8725_65881c70b0b9.slice/crio-a0371bc2a131ce12fedc3462c5298a70dded2f98341d4a7637b28480a9db49c4 WatchSource:0}: Error finding container a0371bc2a131ce12fedc3462c5298a70dded2f98341d4a7637b28480a9db49c4: Status 404 returned error can't find the container with id a0371bc2a131ce12fedc3462c5298a70dded2f98341d4a7637b28480a9db49c4 Jul 14 01:01:23.228713 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:23.228679 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vn5k" event={"ID":"1eb58e6e-5b22-467f-8725-65881c70b0b9","Type":"ContainerStarted","Data":"a0371bc2a131ce12fedc3462c5298a70dded2f98341d4a7637b28480a9db49c4"} Jul 14 01:01:24.852068 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:24.852035 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:24.934757 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:24.934722 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:25.237732 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:25.237653 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vn5k" event={"ID":"1eb58e6e-5b22-467f-8725-65881c70b0b9","Type":"ContainerStarted","Data":"8d02015bca225f5cfc2e200b00d5a40daf01968e43eaab96b819d44958b50979"} Jul 14 01:01:25.237732 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:25.237704 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vn5k" event={"ID":"1eb58e6e-5b22-467f-8725-65881c70b0b9","Type":"ContainerStarted","Data":"d3a433f166d6acac81945dbc017b3cbfa760a9226a4bf218e84f6ba2651d4108"} Jul 14 01:01:25.253261 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:25.253202 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5vn5k" podStartSLOduration=130.650374279 podStartE2EDuration="2m12.253182731s" totalImagesPullingTime="1.602808452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:01:25.25279255 +0000 UTC m=+133.123227742" watchObservedRunningTime="2026-07-14 01:01:25.253182731 +0000 UTC m=+133.123617923" Jul 14 01:01:25.336775 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:25.336742 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:25.388372 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:25.388332 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:27.213374 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:27.213336 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:27.313514 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:27.313473 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:32.429790 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:32.429745 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:32.531562 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:32.531531 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:32.579274 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:32.579231 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:33.063836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.063799 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-987fb9fff-qn7g7" podUID="9d3aa72b-a17f-4bd1-b225-51c635dc0172" containerName="console" containerID="cri-o://d1c1fe7d2c2c83ed1de94d2481d7f7102ab8c71d4cd81ad1f70e991919e1b2db" gracePeriod=15 Jul 14 01:01:33.273485 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.273457 2570 generic.go:356] "Generic (PLEG): container finished" podID="9d3aa72b-a17f-4bd1-b225-51c635dc0172" containerID="d1c1fe7d2c2c83ed1de94d2481d7f7102ab8c71d4cd81ad1f70e991919e1b2db" exitCode=0 Jul 14 01:01:33.273655 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.273535 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-987fb9fff-qn7g7" event={"ID":"9d3aa72b-a17f-4bd1-b225-51c635dc0172","Type":"ContainerDied","Data":"d1c1fe7d2c2c83ed1de94d2481d7f7102ab8c71d4cd81ad1f70e991919e1b2db"} Jul 14 01:01:33.334208 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.334146 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:01:33.498068 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498033 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-oauth-config\") pod \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " Jul 14 01:01:33.498523 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498113 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chdk9\" (UniqueName: \"kubernetes.io/projected/9d3aa72b-a17f-4bd1-b225-51c635dc0172-kube-api-access-chdk9\") pod \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " Jul 14 01:01:33.498523 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498135 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-oauth-serving-cert\") pod \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " Jul 14 01:01:33.498523 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498166 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-service-ca\") pod \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " Jul 14 01:01:33.498523 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498203 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-config\") pod \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " Jul 14 01:01:33.498523 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498228 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-serving-cert\") pod \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\" (UID: \"9d3aa72b-a17f-4bd1-b225-51c635dc0172\") " Jul 14 01:01:33.498769 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498595 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-config" (OuterVolumeSpecName: "console-config") pod "9d3aa72b-a17f-4bd1-b225-51c635dc0172" (UID: "9d3aa72b-a17f-4bd1-b225-51c635dc0172"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:01:33.498769 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498605 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-service-ca" (OuterVolumeSpecName: "service-ca") pod "9d3aa72b-a17f-4bd1-b225-51c635dc0172" (UID: "9d3aa72b-a17f-4bd1-b225-51c635dc0172"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:01:33.498769 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.498605 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9d3aa72b-a17f-4bd1-b225-51c635dc0172" (UID: "9d3aa72b-a17f-4bd1-b225-51c635dc0172"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:01:33.500590 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.500558 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9d3aa72b-a17f-4bd1-b225-51c635dc0172" (UID: "9d3aa72b-a17f-4bd1-b225-51c635dc0172"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:01:33.500694 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.500562 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d3aa72b-a17f-4bd1-b225-51c635dc0172-kube-api-access-chdk9" (OuterVolumeSpecName: "kube-api-access-chdk9") pod "9d3aa72b-a17f-4bd1-b225-51c635dc0172" (UID: "9d3aa72b-a17f-4bd1-b225-51c635dc0172"). InnerVolumeSpecName "kube-api-access-chdk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:01:33.500694 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.500606 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9d3aa72b-a17f-4bd1-b225-51c635dc0172" (UID: "9d3aa72b-a17f-4bd1-b225-51c635dc0172"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:01:33.599351 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.599269 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chdk9\" (UniqueName: \"kubernetes.io/projected/9d3aa72b-a17f-4bd1-b225-51c635dc0172-kube-api-access-chdk9\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:33.599351 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.599299 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-oauth-serving-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:33.599351 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.599310 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-service-ca\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:33.599351 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.599317 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-config\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:33.599351 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.599325 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-serving-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:33.599351 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:33.599333 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d3aa72b-a17f-4bd1-b225-51c635dc0172-console-oauth-config\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:34.278066 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:34.278030 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-987fb9fff-qn7g7" event={"ID":"9d3aa72b-a17f-4bd1-b225-51c635dc0172","Type":"ContainerDied","Data":"956baab60b3ebecfb8e3c02302bfdceee49b3bde2db29760a83e076f972888ed"} Jul 14 01:01:34.278314 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:34.278087 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-987fb9fff-qn7g7" Jul 14 01:01:34.278314 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:34.278114 2570 scope.go:117] "RemoveContainer" containerID="d1c1fe7d2c2c83ed1de94d2481d7f7102ab8c71d4cd81ad1f70e991919e1b2db" Jul 14 01:01:34.300147 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:34.300123 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-987fb9fff-qn7g7"] Jul 14 01:01:34.303953 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:34.303907 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-987fb9fff-qn7g7"] Jul 14 01:01:34.664232 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:34.664147 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d3aa72b-a17f-4bd1-b225-51c635dc0172" path="/var/lib/kubelet/pods/9d3aa72b-a17f-4bd1-b225-51c635dc0172/volumes" Jul 14 01:01:35.281694 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.281646 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" podUID="0733d9ff-74bf-4f4d-a509-6a659b58d3b6" containerName="registry" containerID="cri-o://74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69" gracePeriod=30 Jul 14 01:01:35.560328 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.560258 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:01:35.716069 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716035 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") pod \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " Jul 14 01:01:35.716069 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716073 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-certificates\") pod \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " Jul 14 01:01:35.716555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716103 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-bound-sa-token\") pod \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " Jul 14 01:01:35.716555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716136 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-ca-trust-extracted\") pod \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " Jul 14 01:01:35.716555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716321 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-image-registry-private-configuration\") pod \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " Jul 14 01:01:35.716555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716391 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-trusted-ca\") pod \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " Jul 14 01:01:35.716555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716429 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-installation-pull-secrets\") pod \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " Jul 14 01:01:35.716555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716457 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsf6z\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-kube-api-access-dsf6z\") pod \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\" (UID: \"0733d9ff-74bf-4f4d-a509-6a659b58d3b6\") " Jul 14 01:01:35.716848 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716561 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0733d9ff-74bf-4f4d-a509-6a659b58d3b6" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:01:35.716905 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.716882 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0733d9ff-74bf-4f4d-a509-6a659b58d3b6" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:01:35.717206 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.717156 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-certificates\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:35.718822 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.718750 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0733d9ff-74bf-4f4d-a509-6a659b58d3b6" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:01:35.718822 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.718781 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0733d9ff-74bf-4f4d-a509-6a659b58d3b6" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:01:35.719275 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.719251 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0733d9ff-74bf-4f4d-a509-6a659b58d3b6" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:01:35.719368 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.719350 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-kube-api-access-dsf6z" (OuterVolumeSpecName: "kube-api-access-dsf6z") pod "0733d9ff-74bf-4f4d-a509-6a659b58d3b6" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6"). InnerVolumeSpecName "kube-api-access-dsf6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:01:35.719518 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.719503 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0733d9ff-74bf-4f4d-a509-6a659b58d3b6" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:01:35.734589 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.734559 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0733d9ff-74bf-4f4d-a509-6a659b58d3b6" (UID: "0733d9ff-74bf-4f4d-a509-6a659b58d3b6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:01:35.817717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.817640 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-trusted-ca\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:35.817717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.817666 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-installation-pull-secrets\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:35.817717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.817678 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsf6z\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-kube-api-access-dsf6z\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:35.817717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.817687 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-registry-tls\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:35.817717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.817696 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-bound-sa-token\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:35.817717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.817703 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-ca-trust-extracted\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:35.817717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:35.817712 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0733d9ff-74bf-4f4d-a509-6a659b58d3b6-image-registry-private-configuration\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:01:36.287527 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.287492 2570 generic.go:356] "Generic (PLEG): container finished" podID="0733d9ff-74bf-4f4d-a509-6a659b58d3b6" containerID="74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69" exitCode=0 Jul 14 01:01:36.287688 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.287531 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" Jul 14 01:01:36.287688 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.287554 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" event={"ID":"0733d9ff-74bf-4f4d-a509-6a659b58d3b6","Type":"ContainerDied","Data":"74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69"} Jul 14 01:01:36.287688 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.287603 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749c5644cd-mrk7v" event={"ID":"0733d9ff-74bf-4f4d-a509-6a659b58d3b6","Type":"ContainerDied","Data":"2ece2d25f25c6515169c00d66711212dd2e87149028290957e7ab5cff78127bc"} Jul 14 01:01:36.287688 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.287626 2570 scope.go:117] "RemoveContainer" containerID="74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69" Jul 14 01:01:36.296375 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.296358 2570 scope.go:117] "RemoveContainer" containerID="74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69" Jul 14 01:01:36.296627 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:01:36.296603 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69\": container with ID starting with 74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69 not found: ID does not exist" containerID="74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69" Jul 14 01:01:36.296687 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.296635 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69"} err="failed to get container status \"74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69\": rpc error: code = NotFound desc = could not find container \"74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69\": container with ID starting with 74fb8f982ea4a26dd29ab8e97592b18bf380263e6eda3cb0190f50fee6cbfd69 not found: ID does not exist" Jul 14 01:01:36.307570 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.307542 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-749c5644cd-mrk7v"] Jul 14 01:01:36.312778 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.312757 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-749c5644cd-mrk7v"] Jul 14 01:01:36.664236 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:36.664163 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0733d9ff-74bf-4f4d-a509-6a659b58d3b6" path="/var/lib/kubelet/pods/0733d9ff-74bf-4f4d-a509-6a659b58d3b6/volumes" Jul 14 01:01:42.215436 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:42.215398 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:01:42.272365 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:01:42.272324 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:22.865205 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:22.865173 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:24.610066 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:24.610031 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:25.523487 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:25.523450 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:29.698129 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.698092 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4"] Jul 14 01:02:29.698500 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.698340 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d3aa72b-a17f-4bd1-b225-51c635dc0172" containerName="console" Jul 14 01:02:29.698500 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.698350 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d3aa72b-a17f-4bd1-b225-51c635dc0172" containerName="console" Jul 14 01:02:29.698500 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.698366 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0733d9ff-74bf-4f4d-a509-6a659b58d3b6" containerName="registry" Jul 14 01:02:29.698500 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.698372 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0733d9ff-74bf-4f4d-a509-6a659b58d3b6" containerName="registry" Jul 14 01:02:29.698500 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.698413 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d3aa72b-a17f-4bd1-b225-51c635dc0172" containerName="console" Jul 14 01:02:29.698500 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.698421 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0733d9ff-74bf-4f4d-a509-6a659b58d3b6" containerName="registry" Jul 14 01:02:29.702544 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.702528 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.704944 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.704905 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 01:02:29.705093 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.705032 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 01:02:29.705093 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.705061 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6lvh5\"" Jul 14 01:02:29.705337 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.705324 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 01:02:29.705379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.705328 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 01:02:29.706028 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.705991 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 01:02:29.709952 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.709930 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 01:02:29.714746 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.714724 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4"] Jul 14 01:02:29.793674 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.793639 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-telemeter-client-tls\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.793674 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.793680 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-secret-telemeter-client\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.793887 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.793698 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.793887 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.793754 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-serving-certs-ca-bundle\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.793887 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.793838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.793887 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.793859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8qvl\" (UniqueName: \"kubernetes.io/projected/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-kube-api-access-f8qvl\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.793887 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.793876 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-federate-client-tls\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.794071 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.793946 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-metrics-client-ca\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.895171 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.895120 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-secret-telemeter-client\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.895171 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.895170 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.895428 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.895210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-serving-certs-ca-bundle\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.895428 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.895238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.895428 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.895261 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8qvl\" (UniqueName: \"kubernetes.io/projected/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-kube-api-access-f8qvl\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.895428 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.895286 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-federate-client-tls\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.895632 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.895426 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-metrics-client-ca\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.895632 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.895471 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-telemeter-client-tls\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.896101 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.896046 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-serving-certs-ca-bundle\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.896369 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.896348 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.896480 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.896459 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-metrics-client-ca\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.897969 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.897940 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-telemeter-client-tls\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.898060 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.897986 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-secret-telemeter-client\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.898164 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.898147 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-federate-client-tls\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.898251 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.898232 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:29.903187 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:29.903160 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8qvl\" (UniqueName: \"kubernetes.io/projected/5660a8a6-86f5-4eb1-853c-8f471ebefe1a-kube-api-access-f8qvl\") pod \"telemeter-client-66f4d4c5bf-ln6x4\" (UID: \"5660a8a6-86f5-4eb1-853c-8f471ebefe1a\") " pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:30.011494 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:30.011406 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" Jul 14 01:02:30.142805 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:30.142779 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4"] Jul 14 01:02:30.144812 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:02:30.144777 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5660a8a6_86f5_4eb1_853c_8f471ebefe1a.slice/crio-d0ef5228f06bdbae730903bec3c22b2f7f68c771684cbff0634f68d59948d167 WatchSource:0}: Error finding container d0ef5228f06bdbae730903bec3c22b2f7f68c771684cbff0634f68d59948d167: Status 404 returned error can't find the container with id d0ef5228f06bdbae730903bec3c22b2f7f68c771684cbff0634f68d59948d167 Jul 14 01:02:30.472617 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:30.472583 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" event={"ID":"5660a8a6-86f5-4eb1-853c-8f471ebefe1a","Type":"ContainerStarted","Data":"d0ef5228f06bdbae730903bec3c22b2f7f68c771684cbff0634f68d59948d167"} Jul 14 01:02:33.484727 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:33.484684 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" event={"ID":"5660a8a6-86f5-4eb1-853c-8f471ebefe1a","Type":"ContainerStarted","Data":"41374d0c692b1e5773dd19278054fad68cf532d3f8a1c3a9f3414f254431f140"} Jul 14 01:02:34.490143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:34.490105 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" event={"ID":"5660a8a6-86f5-4eb1-853c-8f471ebefe1a","Type":"ContainerStarted","Data":"ba0b3ae216af3cbe612ac5cd3ad213a79e2567202decf1b413f820a671593fe6"} Jul 14 01:02:34.490546 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:34.490179 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" event={"ID":"5660a8a6-86f5-4eb1-853c-8f471ebefe1a","Type":"ContainerStarted","Data":"f3006ebd660df5d14c094d500024641ab38f06ea68aeba1a03a0b3df4f165037"} Jul 14 01:02:34.514580 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:34.514533 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66f4d4c5bf-ln6x4" podStartSLOduration=2.174994481 podStartE2EDuration="5.514517611s" totalImagesPullingTime="3.33952313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:02:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:02:34.512508304 +0000 UTC m=+202.382943692" watchObservedRunningTime="2026-07-14 01:02:34.514517611 +0000 UTC m=+202.384952800" Jul 14 01:02:35.522281 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.522254 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cfb4c6fdf-2xjsd"] Jul 14 01:02:35.525531 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.525507 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.527961 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.527941 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 01:02:35.529065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.529044 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 01:02:35.529212 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.529081 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 01:02:35.529212 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.529089 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 01:02:35.529365 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.529234 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 01:02:35.529365 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.529267 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xt9b8\"" Jul 14 01:02:35.533938 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.533899 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 01:02:35.536362 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.536342 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfb4c6fdf-2xjsd"] Jul 14 01:02:35.576046 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.576021 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:35.627629 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.627594 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:35.638658 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.638627 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-trusted-ca-bundle\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.638762 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.638667 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-oauth-serving-cert\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.638762 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.638691 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9c24\" (UniqueName: \"kubernetes.io/projected/03ec8f5d-3d27-442a-8499-5359f6a77465-kube-api-access-r9c24\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.638850 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.638761 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-console-config\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.638850 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.638793 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-service-ca\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.638850 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.638826 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-oauth-config\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.639027 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.638903 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-serving-cert\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.740182 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.740146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-serving-cert\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.740339 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.740201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-trusted-ca-bundle\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.740339 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.740228 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-oauth-serving-cert\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.740339 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.740250 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9c24\" (UniqueName: \"kubernetes.io/projected/03ec8f5d-3d27-442a-8499-5359f6a77465-kube-api-access-r9c24\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.740339 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.740281 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-console-config\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.740492 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.740430 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-service-ca\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.740492 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.740486 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-oauth-config\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.741007 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.740986 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-oauth-serving-cert\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.741231 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.741213 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-trusted-ca-bundle\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.741307 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.741291 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-console-config\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.741346 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.741325 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-service-ca\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.742852 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.742820 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-serving-cert\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.742988 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.742946 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-oauth-config\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.748044 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.748017 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9c24\" (UniqueName: \"kubernetes.io/projected/03ec8f5d-3d27-442a-8499-5359f6a77465-kube-api-access-r9c24\") pod \"console-7cfb4c6fdf-2xjsd\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.835853 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.835771 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:35.961879 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:35.961846 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cfb4c6fdf-2xjsd"] Jul 14 01:02:35.965090 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:02:35.965061 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ec8f5d_3d27_442a_8499_5359f6a77465.slice/crio-7a01c306914d46d527f7eff64ac4a7d34da7c472c29f76c2fb66e161e0c7d402 WatchSource:0}: Error finding container 7a01c306914d46d527f7eff64ac4a7d34da7c472c29f76c2fb66e161e0c7d402: Status 404 returned error can't find the container with id 7a01c306914d46d527f7eff64ac4a7d34da7c472c29f76c2fb66e161e0c7d402 Jul 14 01:02:36.503046 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:36.503006 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb4c6fdf-2xjsd" event={"ID":"03ec8f5d-3d27-442a-8499-5359f6a77465","Type":"ContainerStarted","Data":"9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8"} Jul 14 01:02:36.503209 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:36.503080 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb4c6fdf-2xjsd" event={"ID":"03ec8f5d-3d27-442a-8499-5359f6a77465","Type":"ContainerStarted","Data":"7a01c306914d46d527f7eff64ac4a7d34da7c472c29f76c2fb66e161e0c7d402"} Jul 14 01:02:36.520259 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:36.520215 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cfb4c6fdf-2xjsd" podStartSLOduration=1.5202015979999999 podStartE2EDuration="1.520201598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:02:36.51948854 +0000 UTC m=+204.389923729" watchObservedRunningTime="2026-07-14 01:02:36.520201598 +0000 UTC m=+204.390636788" Jul 14 01:02:39.844499 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:39.844469 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:39.907991 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:39.907962 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:41.015903 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.015874 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfb4c6fdf-2xjsd"] Jul 14 01:02:41.044721 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.044691 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-749685dd64-4pmkb"] Jul 14 01:02:41.047829 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.047812 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.056622 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.056597 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749685dd64-4pmkb"] Jul 14 01:02:41.078598 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.078566 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-console-config\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.078766 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.078608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc2bd\" (UniqueName: \"kubernetes.io/projected/1e2c998a-a418-4778-8859-f2b3578c129a-kube-api-access-pc2bd\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.078766 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.078636 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-trusted-ca-bundle\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.078766 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.078655 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c998a-a418-4778-8859-f2b3578c129a-console-serving-cert\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.078766 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.078679 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-oauth-serving-cert\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.078766 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.078696 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c998a-a418-4778-8859-f2b3578c129a-console-oauth-config\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.078766 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.078711 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-service-ca\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.179906 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.179868 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc2bd\" (UniqueName: \"kubernetes.io/projected/1e2c998a-a418-4778-8859-f2b3578c129a-kube-api-access-pc2bd\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.180118 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.179951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-trusted-ca-bundle\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.180118 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.179978 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c998a-a418-4778-8859-f2b3578c129a-console-serving-cert\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.180118 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.180003 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-oauth-serving-cert\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.180118 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.180054 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c998a-a418-4778-8859-f2b3578c129a-console-oauth-config\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.180118 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.180102 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-service-ca\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.180370 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.180180 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-console-config\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.180883 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.180765 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-service-ca\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.180883 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.180796 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-oauth-serving-cert\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.181120 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.180947 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-trusted-ca-bundle\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.181120 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.180964 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c998a-a418-4778-8859-f2b3578c129a-console-config\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.182610 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.182576 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c998a-a418-4778-8859-f2b3578c129a-console-oauth-config\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.182728 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.182706 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c998a-a418-4778-8859-f2b3578c129a-console-serving-cert\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.187474 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.187456 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc2bd\" (UniqueName: \"kubernetes.io/projected/1e2c998a-a418-4778-8859-f2b3578c129a-kube-api-access-pc2bd\") pod \"console-749685dd64-4pmkb\" (UID: \"1e2c998a-a418-4778-8859-f2b3578c129a\") " pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.275158 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.275077 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:41.357073 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.357043 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:41.479441 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.479420 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-749685dd64-4pmkb"] Jul 14 01:02:41.481991 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:02:41.481957 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2c998a_a418_4778_8859_f2b3578c129a.slice/crio-da3bbf385a7572e367e4d3e8a88d3fa28a7e0f6fb3bd347936e43b4ef95dd1a5 WatchSource:0}: Error finding container da3bbf385a7572e367e4d3e8a88d3fa28a7e0f6fb3bd347936e43b4ef95dd1a5: Status 404 returned error can't find the container with id da3bbf385a7572e367e4d3e8a88d3fa28a7e0f6fb3bd347936e43b4ef95dd1a5 Jul 14 01:02:41.520805 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:41.520778 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749685dd64-4pmkb" event={"ID":"1e2c998a-a418-4778-8859-f2b3578c129a","Type":"ContainerStarted","Data":"da3bbf385a7572e367e4d3e8a88d3fa28a7e0f6fb3bd347936e43b4ef95dd1a5"} Jul 14 01:02:42.526004 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:42.525963 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-749685dd64-4pmkb" event={"ID":"1e2c998a-a418-4778-8859-f2b3578c129a","Type":"ContainerStarted","Data":"087ca3dc7dac570490a4eb08b12c0e8f3a93904bdfa964fc49268228722be201"} Jul 14 01:02:42.544678 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:42.544624 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-749685dd64-4pmkb" podStartSLOduration=1.544603993 podStartE2EDuration="1.544603993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:02:42.54311841 +0000 UTC m=+210.413553614" watchObservedRunningTime="2026-07-14 01:02:42.544603993 +0000 UTC m=+210.415039182" Jul 14 01:02:43.489344 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:43.489305 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:43.543886 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:43.543851 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:45.836858 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:45.836817 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:02:51.357970 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:51.357933 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:51.358357 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:51.357994 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:51.362508 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:51.362481 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:51.562795 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:51.562766 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-749685dd64-4pmkb" Jul 14 01:02:51.702811 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:51.702769 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:51.803099 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:51.803065 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:51.875805 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:51.875777 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:57.226688 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:57.226642 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:02:57.328221 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:02:57.328189 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:03.536296 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:03.536257 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:06.036045 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.035998 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cfb4c6fdf-2xjsd" podUID="03ec8f5d-3d27-442a-8499-5359f6a77465" containerName="console" containerID="cri-o://9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8" gracePeriod=15 Jul 14 01:03:06.286128 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.286067 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:03:06.376395 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.376360 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-trusted-ca-bundle\") pod \"03ec8f5d-3d27-442a-8499-5359f6a77465\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " Jul 14 01:03:06.376589 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.376415 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9c24\" (UniqueName: \"kubernetes.io/projected/03ec8f5d-3d27-442a-8499-5359f6a77465-kube-api-access-r9c24\") pod \"03ec8f5d-3d27-442a-8499-5359f6a77465\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " Jul 14 01:03:06.376589 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.376473 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-oauth-serving-cert\") pod \"03ec8f5d-3d27-442a-8499-5359f6a77465\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " Jul 14 01:03:06.376589 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.376530 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-serving-cert\") pod \"03ec8f5d-3d27-442a-8499-5359f6a77465\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " Jul 14 01:03:06.376589 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.376568 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-console-config\") pod \"03ec8f5d-3d27-442a-8499-5359f6a77465\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " Jul 14 01:03:06.376792 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.376600 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-oauth-config\") pod \"03ec8f5d-3d27-442a-8499-5359f6a77465\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " Jul 14 01:03:06.376792 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.376635 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-service-ca\") pod \"03ec8f5d-3d27-442a-8499-5359f6a77465\" (UID: \"03ec8f5d-3d27-442a-8499-5359f6a77465\") " Jul 14 01:03:06.376979 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.376950 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03ec8f5d-3d27-442a-8499-5359f6a77465" (UID: "03ec8f5d-3d27-442a-8499-5359f6a77465"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:03:06.377095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.377039 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-console-config" (OuterVolumeSpecName: "console-config") pod "03ec8f5d-3d27-442a-8499-5359f6a77465" (UID: "03ec8f5d-3d27-442a-8499-5359f6a77465"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:03:06.377152 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.377123 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-service-ca" (OuterVolumeSpecName: "service-ca") pod "03ec8f5d-3d27-442a-8499-5359f6a77465" (UID: "03ec8f5d-3d27-442a-8499-5359f6a77465"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:03:06.377214 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.377149 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03ec8f5d-3d27-442a-8499-5359f6a77465" (UID: "03ec8f5d-3d27-442a-8499-5359f6a77465"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:03:06.378832 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.378803 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03ec8f5d-3d27-442a-8499-5359f6a77465-kube-api-access-r9c24" (OuterVolumeSpecName: "kube-api-access-r9c24") pod "03ec8f5d-3d27-442a-8499-5359f6a77465" (UID: "03ec8f5d-3d27-442a-8499-5359f6a77465"). InnerVolumeSpecName "kube-api-access-r9c24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:03:06.378957 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.378884 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03ec8f5d-3d27-442a-8499-5359f6a77465" (UID: "03ec8f5d-3d27-442a-8499-5359f6a77465"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:03:06.378957 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.378935 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03ec8f5d-3d27-442a-8499-5359f6a77465" (UID: "03ec8f5d-3d27-442a-8499-5359f6a77465"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:03:06.477216 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.477177 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-oauth-serving-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:03:06.477216 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.477210 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-serving-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:03:06.477216 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.477220 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-console-config\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:03:06.477216 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.477228 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03ec8f5d-3d27-442a-8499-5359f6a77465-console-oauth-config\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:03:06.477480 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.477236 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-service-ca\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:03:06.477480 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.477245 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03ec8f5d-3d27-442a-8499-5359f6a77465-trusted-ca-bundle\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:03:06.477480 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.477252 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9c24\" (UniqueName: \"kubernetes.io/projected/03ec8f5d-3d27-442a-8499-5359f6a77465-kube-api-access-r9c24\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:03:06.611283 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.611195 2570 generic.go:356] "Generic (PLEG): container finished" podID="03ec8f5d-3d27-442a-8499-5359f6a77465" containerID="9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8" exitCode=0 Jul 14 01:03:06.611283 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.611241 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cfb4c6fdf-2xjsd" Jul 14 01:03:06.611283 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.611262 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb4c6fdf-2xjsd" event={"ID":"03ec8f5d-3d27-442a-8499-5359f6a77465","Type":"ContainerDied","Data":"9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8"} Jul 14 01:03:06.611477 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.611313 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cfb4c6fdf-2xjsd" event={"ID":"03ec8f5d-3d27-442a-8499-5359f6a77465","Type":"ContainerDied","Data":"7a01c306914d46d527f7eff64ac4a7d34da7c472c29f76c2fb66e161e0c7d402"} Jul 14 01:03:06.611477 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.611341 2570 scope.go:117] "RemoveContainer" containerID="9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8" Jul 14 01:03:06.619607 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.619588 2570 scope.go:117] "RemoveContainer" containerID="9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8" Jul 14 01:03:06.619860 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:03:06.619840 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8\": container with ID starting with 9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8 not found: ID does not exist" containerID="9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8" Jul 14 01:03:06.619905 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.619868 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8"} err="failed to get container status \"9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8\": rpc error: code = NotFound desc = could not find container \"9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8\": container with ID starting with 9386b3def88a4a52925a2ab906599c64d051faa46d787a6012a625e48d73ecc8 not found: ID does not exist" Jul 14 01:03:06.632775 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.632742 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cfb4c6fdf-2xjsd"] Jul 14 01:03:06.637462 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.637425 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cfb4c6fdf-2xjsd"] Jul 14 01:03:06.664875 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:06.664844 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03ec8f5d-3d27-442a-8499-5359f6a77465" path="/var/lib/kubelet/pods/03ec8f5d-3d27-442a-8499-5359f6a77465/volumes" Jul 14 01:03:23.802672 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:23.802636 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:23.902380 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:23.902348 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:50.348354 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:50.348267 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:51.532652 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:51.532618 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:53.957941 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:53.957880 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:54.016517 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:54.016485 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:54.731360 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:54.731322 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:54.832527 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:54.832488 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:56.278493 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.278458 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:56.421569 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.421526 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:56.477454 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.477420 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c"] Jul 14 01:03:56.477702 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.477690 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ec8f5d-3d27-442a-8499-5359f6a77465" containerName="console" Jul 14 01:03:56.477749 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.477704 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ec8f5d-3d27-442a-8499-5359f6a77465" containerName="console" Jul 14 01:03:56.477791 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.477760 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ec8f5d-3d27-442a-8499-5359f6a77465" containerName="console" Jul 14 01:03:56.480750 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.480735 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.483232 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.483201 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 01:03:56.484190 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.484174 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 01:03:56.484363 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.484200 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5d4tv\"" Jul 14 01:03:56.491987 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.491965 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c"] Jul 14 01:03:56.550108 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.550034 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxfhw\" (UniqueName: \"kubernetes.io/projected/c4508057-6742-417f-a87e-8926de3234ec-kube-api-access-sxfhw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.550108 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.550074 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.550269 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.550108 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.651253 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.651222 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.651430 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.651262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.651430 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.651324 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxfhw\" (UniqueName: \"kubernetes.io/projected/c4508057-6742-417f-a87e-8926de3234ec-kube-api-access-sxfhw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.651656 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.651635 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.651656 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.651650 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.666030 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.666008 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxfhw\" (UniqueName: \"kubernetes.io/projected/c4508057-6742-417f-a87e-8926de3234ec-kube-api-access-sxfhw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.789313 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.789285 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:03:56.917547 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:56.917398 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c"] Jul 14 01:03:56.921883 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:03:56.921852 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4508057_6742_417f_a87e_8926de3234ec.slice/crio-13476bf58e901c49ee67291c8a8f776088463600d7bf826b493a6d0f922ff950 WatchSource:0}: Error finding container 13476bf58e901c49ee67291c8a8f776088463600d7bf826b493a6d0f922ff950: Status 404 returned error can't find the container with id 13476bf58e901c49ee67291c8a8f776088463600d7bf826b493a6d0f922ff950 Jul 14 01:03:57.788393 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:57.788341 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" event={"ID":"c4508057-6742-417f-a87e-8926de3234ec","Type":"ContainerStarted","Data":"13476bf58e901c49ee67291c8a8f776088463600d7bf826b493a6d0f922ff950"} Jul 14 01:03:58.711852 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:58.711811 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:03:58.930027 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:03:58.929969 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:04:00.956936 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:00.956881 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:04:01.058705 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:01.058661 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:04:03.814905 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:03.814869 2570 generic.go:356] "Generic (PLEG): container finished" podID="c4508057-6742-417f-a87e-8926de3234ec" containerID="1eef5e41b8acd8a5304f2e8a98a848b3d3c4e0864dd77b64026cf96719d519f9" exitCode=0 Jul 14 01:04:03.815310 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:03.814908 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" event={"ID":"c4508057-6742-417f-a87e-8926de3234ec","Type":"ContainerDied","Data":"1eef5e41b8acd8a5304f2e8a98a848b3d3c4e0864dd77b64026cf96719d519f9"} Jul 14 01:04:04.693890 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:04.693851 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:04:04.826143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:04.826058 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:04:05.203067 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:05.203023 2570 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06" Jul 14 01:04:05.203271 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:05.203172 2570 kuberuntime_manager.go:1459] "Unhandled Error" err="init container pull start failed in pod 77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c_openshift-marketplace(c4508057-6742-417f-a87e-8926de3234ec): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 14 01:04:05.203271 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:05.203227 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" podUID="c4508057-6742-417f-a87e-8926de3234ec" Jul 14 01:04:05.823701 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:05.823667 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" podUID="c4508057-6742-417f-a87e-8926de3234ec" Jul 14 01:04:06.114835 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:06.114742 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:04:09.153011 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.152972 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pqdg4"] Jul 14 01:04:09.157028 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.157002 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pqdg4" Jul 14 01:04:09.159557 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.159524 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 01:04:09.159703 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.159562 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 01:04:09.160379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.160363 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hx5d6\"" Jul 14 01:04:09.172967 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.172932 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pqdg4"] Jul 14 01:04:09.257995 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.257952 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e48e366a-ed87-4ed2-ac9d-a62d6de737bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-pqdg4\" (UID: \"e48e366a-ed87-4ed2-ac9d-a62d6de737bd\") " pod="cert-manager/cert-manager-55b4d954d5-pqdg4" Jul 14 01:04:09.258195 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.258097 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c4jj\" (UniqueName: \"kubernetes.io/projected/e48e366a-ed87-4ed2-ac9d-a62d6de737bd-kube-api-access-4c4jj\") pod \"cert-manager-55b4d954d5-pqdg4\" (UID: \"e48e366a-ed87-4ed2-ac9d-a62d6de737bd\") " pod="cert-manager/cert-manager-55b4d954d5-pqdg4" Jul 14 01:04:09.359485 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.359448 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c4jj\" (UniqueName: \"kubernetes.io/projected/e48e366a-ed87-4ed2-ac9d-a62d6de737bd-kube-api-access-4c4jj\") pod \"cert-manager-55b4d954d5-pqdg4\" (UID: \"e48e366a-ed87-4ed2-ac9d-a62d6de737bd\") " pod="cert-manager/cert-manager-55b4d954d5-pqdg4" Jul 14 01:04:09.359620 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.359502 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e48e366a-ed87-4ed2-ac9d-a62d6de737bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-pqdg4\" (UID: \"e48e366a-ed87-4ed2-ac9d-a62d6de737bd\") " pod="cert-manager/cert-manager-55b4d954d5-pqdg4" Jul 14 01:04:09.368130 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.368095 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e48e366a-ed87-4ed2-ac9d-a62d6de737bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-pqdg4\" (UID: \"e48e366a-ed87-4ed2-ac9d-a62d6de737bd\") " pod="cert-manager/cert-manager-55b4d954d5-pqdg4" Jul 14 01:04:09.368254 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.368169 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c4jj\" (UniqueName: \"kubernetes.io/projected/e48e366a-ed87-4ed2-ac9d-a62d6de737bd-kube-api-access-4c4jj\") pod \"cert-manager-55b4d954d5-pqdg4\" (UID: \"e48e366a-ed87-4ed2-ac9d-a62d6de737bd\") " pod="cert-manager/cert-manager-55b4d954d5-pqdg4" Jul 14 01:04:09.466810 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.466760 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pqdg4" Jul 14 01:04:09.602932 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.602882 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pqdg4"] Jul 14 01:04:09.607338 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:04:09.607305 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode48e366a_ed87_4ed2_ac9d_a62d6de737bd.slice/crio-20b65165196c4c373f5b5ed23d7f34c35d526002d4ce62be652be3b65b274bbd WatchSource:0}: Error finding container 20b65165196c4c373f5b5ed23d7f34c35d526002d4ce62be652be3b65b274bbd: Status 404 returned error can't find the container with id 20b65165196c4c373f5b5ed23d7f34c35d526002d4ce62be652be3b65b274bbd Jul 14 01:04:09.837602 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:09.837517 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pqdg4" event={"ID":"e48e366a-ed87-4ed2-ac9d-a62d6de737bd","Type":"ContainerStarted","Data":"20b65165196c4c373f5b5ed23d7f34c35d526002d4ce62be652be3b65b274bbd"} Jul 14 01:04:13.923052 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:13.923025 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 01:04:14.860231 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:14.860184 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pqdg4" event={"ID":"e48e366a-ed87-4ed2-ac9d-a62d6de737bd","Type":"ContainerStarted","Data":"9aea867a89bd67c70455776c754de43533d7d64598b30b8439e5355ae8317db6"} Jul 14 01:04:14.875230 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:14.875179 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pqdg4" podStartSLOduration=1.51400509 podStartE2EDuration="5.875163378s" totalImagesPullingTime="4.361158288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:04:14.874680423 +0000 UTC m=+302.745115638" watchObservedRunningTime="2026-07-14 01:04:14.875163378 +0000 UTC m=+302.745598569" Jul 14 01:04:20.661278 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:20.661255 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 01:04:22.044700 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:22.044656 2570 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06" Jul 14 01:04:22.045132 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:22.044794 2570 kuberuntime_manager.go:1459] "Unhandled Error" err="init container pull start failed in pod 77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c_openshift-marketplace(c4508057-6742-417f-a87e-8926de3234ec): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 14 01:04:22.045132 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:22.044845 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" podUID="c4508057-6742-417f-a87e-8926de3234ec" Jul 14 01:04:22.756058 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:04:22.756025 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:04:34.661132 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:34.661093 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" podUID="c4508057-6742-417f-a87e-8926de3234ec" Jul 14 01:04:48.839076 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:48.839025 2570 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway" image="registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06" Jul 14 01:04:48.839511 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:48.839155 2570 kuberuntime_manager.go:1459] "Unhandled Error" err="init container pull start failed in pod 77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c_openshift-marketplace(c4508057-6742-417f-a87e-8926de3234ec): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway" logger="UnhandledError" Jul 14 01:04:48.839511 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:04:48.839192 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" podUID="c4508057-6742-417f-a87e-8926de3234ec" Jul 14 01:05:04.661330 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:05:04.661295 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" podUID="c4508057-6742-417f-a87e-8926de3234ec" Jul 14 01:05:16.661509 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:05:16.661372 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"pull\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://registry.redhat.io/leader-worker-set/lws-operator-bundle@sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway; artifact err: get manifest: build image source: reading manifest sha256:f641cf3b2d6659e26eb0ae49c67a3416152a2fbc2f26f490889a2bd169b9ea06 in registry.redhat.io/leader-worker-set/lws-operator-bundle: received unexpected HTTP status: 502 Bad Gateway\"" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" podUID="c4508057-6742-417f-a87e-8926de3234ec" Jul 14 01:05:28.600668 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:05:28.600628 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:05:32.235752 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:05:32.235713 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:05:52.210404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:05:52.210360 2570 generic.go:356] "Generic (PLEG): container finished" podID="c4508057-6742-417f-a87e-8926de3234ec" containerID="f4ad690e826074e52d9826a4022f7de49984628a91f8899dec3b6fa3bfd42b20" exitCode=0 Jul 14 01:05:52.210791 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:05:52.210411 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" event={"ID":"c4508057-6742-417f-a87e-8926de3234ec","Type":"ContainerDied","Data":"f4ad690e826074e52d9826a4022f7de49984628a91f8899dec3b6fa3bfd42b20"} Jul 14 01:06:00.243261 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:00.243229 2570 generic.go:356] "Generic (PLEG): container finished" podID="c4508057-6742-417f-a87e-8926de3234ec" containerID="e7f08f571c0152cef6147c1d0120c3e95b1c6c52f590ffe32a71b445fe796f39" exitCode=0 Jul 14 01:06:00.243646 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:00.243287 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" event={"ID":"c4508057-6742-417f-a87e-8926de3234ec","Type":"ContainerDied","Data":"e7f08f571c0152cef6147c1d0120c3e95b1c6c52f590ffe32a71b445fe796f39"} Jul 14 01:06:01.374869 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.374838 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:06:01.481848 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.481800 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxfhw\" (UniqueName: \"kubernetes.io/projected/c4508057-6742-417f-a87e-8926de3234ec-kube-api-access-sxfhw\") pod \"c4508057-6742-417f-a87e-8926de3234ec\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " Jul 14 01:06:01.481848 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.481869 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-util\") pod \"c4508057-6742-417f-a87e-8926de3234ec\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " Jul 14 01:06:01.482107 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.481942 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-bundle\") pod \"c4508057-6742-417f-a87e-8926de3234ec\" (UID: \"c4508057-6742-417f-a87e-8926de3234ec\") " Jul 14 01:06:01.482330 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.482304 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-bundle" (OuterVolumeSpecName: "bundle") pod "c4508057-6742-417f-a87e-8926de3234ec" (UID: "c4508057-6742-417f-a87e-8926de3234ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:06:01.484276 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.484246 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4508057-6742-417f-a87e-8926de3234ec-kube-api-access-sxfhw" (OuterVolumeSpecName: "kube-api-access-sxfhw") pod "c4508057-6742-417f-a87e-8926de3234ec" (UID: "c4508057-6742-417f-a87e-8926de3234ec"). InnerVolumeSpecName "kube-api-access-sxfhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:06:01.486083 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.486063 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-util" (OuterVolumeSpecName: "util") pod "c4508057-6742-417f-a87e-8926de3234ec" (UID: "c4508057-6742-417f-a87e-8926de3234ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:06:01.583288 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.583185 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxfhw\" (UniqueName: \"kubernetes.io/projected/c4508057-6742-417f-a87e-8926de3234ec-kube-api-access-sxfhw\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:06:01.583288 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.583232 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-util\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:06:01.583288 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:01.583243 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4508057-6742-417f-a87e-8926de3234ec-bundle\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:06:02.252311 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:02.252276 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" event={"ID":"c4508057-6742-417f-a87e-8926de3234ec","Type":"ContainerDied","Data":"13476bf58e901c49ee67291c8a8f776088463600d7bf826b493a6d0f922ff950"} Jul 14 01:06:02.252488 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:02.252325 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13476bf58e901c49ee67291c8a8f776088463600d7bf826b493a6d0f922ff950" Jul 14 01:06:02.252488 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:02.252322 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6cg2c" Jul 14 01:06:05.680682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:05.680614 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:05.780011 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:05.779981 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:12.187134 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:12.187090 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:12.290763 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:12.290730 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:14.614901 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:14.614857 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:18.581064 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.581019 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:18.635758 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.635725 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf"] Jul 14 01:06:18.636048 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.636035 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4508057-6742-417f-a87e-8926de3234ec" containerName="extract" Jul 14 01:06:18.636095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.636050 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4508057-6742-417f-a87e-8926de3234ec" containerName="extract" Jul 14 01:06:18.636095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.636061 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4508057-6742-417f-a87e-8926de3234ec" containerName="pull" Jul 14 01:06:18.636095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.636067 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4508057-6742-417f-a87e-8926de3234ec" containerName="pull" Jul 14 01:06:18.636095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.636073 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4508057-6742-417f-a87e-8926de3234ec" containerName="util" Jul 14 01:06:18.636095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.636078 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4508057-6742-417f-a87e-8926de3234ec" containerName="util" Jul 14 01:06:18.636244 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.636119 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4508057-6742-417f-a87e-8926de3234ec" containerName="extract" Jul 14 01:06:18.638856 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.638840 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.641189 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.641164 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 01:06:18.642236 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.642207 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 01:06:18.642358 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.642259 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 01:06:18.642358 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.642286 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 01:06:18.642358 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.642319 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 01:06:18.642358 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.642351 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gq2vk\"" Jul 14 01:06:18.647163 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.647141 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf"] Jul 14 01:06:18.656530 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.656489 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:18.718113 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.718075 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-metrics-cert\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.718330 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.718200 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-manager-config\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.718508 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.718481 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-cert\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.718580 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.718521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvqc\" (UniqueName: \"kubernetes.io/projected/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-kube-api-access-lqvqc\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.819453 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.819416 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-cert\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.819453 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.819455 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvqc\" (UniqueName: \"kubernetes.io/projected/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-kube-api-access-lqvqc\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.819665 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.819487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-metrics-cert\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.819665 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.819529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-manager-config\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.820256 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.820231 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-manager-config\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.822141 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.822117 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-metrics-cert\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.822238 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.822174 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-cert\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.828476 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.828448 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvqc\" (UniqueName: \"kubernetes.io/projected/9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812-kube-api-access-lqvqc\") pod \"lws-controller-manager-7cb746fd84-bccnf\" (UID: \"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812\") " pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:18.948802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:18.948751 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:19.081493 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:19.081468 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf"] Jul 14 01:06:19.084155 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:06:19.084129 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4a7dfc_c3b6_49fc_a185_c8e4b5a29812.slice/crio-4e76d42e705b689fe16b2209b7ed85ce5675e2a53b5207de7ec677f6bd3aec52 WatchSource:0}: Error finding container 4e76d42e705b689fe16b2209b7ed85ce5675e2a53b5207de7ec677f6bd3aec52: Status 404 returned error can't find the container with id 4e76d42e705b689fe16b2209b7ed85ce5675e2a53b5207de7ec677f6bd3aec52 Jul 14 01:06:19.319731 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:19.319640 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" event={"ID":"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812","Type":"ContainerStarted","Data":"4e76d42e705b689fe16b2209b7ed85ce5675e2a53b5207de7ec677f6bd3aec52"} Jul 14 01:06:21.329585 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:21.329551 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" event={"ID":"9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812","Type":"ContainerStarted","Data":"8c9885fba5c048104337eba7fd514a0ecf46dfbfbdb6e04dfb880d20721232d2"} Jul 14 01:06:21.330047 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:21.329679 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:21.344828 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:21.344776 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" podStartSLOduration=1.806943832 podStartE2EDuration="3.344761763s" totalImagesPullingTime="1.537817931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:06:21.343492259 +0000 UTC m=+429.213927449" watchObservedRunningTime="2026-07-14 01:06:21.344761763 +0000 UTC m=+429.215196953" Jul 14 01:06:27.647123 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:27.647085 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:27.772159 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:27.772119 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:28.452278 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.452233 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:28.711131 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.711036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:28.820802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.820771 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:28.861279 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.861248 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp"] Jul 14 01:06:28.867681 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.867658 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:28.870527 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.870509 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 01:06:28.870645 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.870514 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 01:06:28.870909 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.870893 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 01:06:28.871025 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.870981 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 01:06:28.871088 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.871054 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pscwn\"" Jul 14 01:06:28.879293 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.879272 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp"] Jul 14 01:06:28.974945 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:28.974841 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:29.002929 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.002889 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-manifests\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.003024 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.002944 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-tmp\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.003024 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.003002 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-apiservice-cert\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.003087 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.003035 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-webhook-cert\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.003087 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.003076 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kkv5\" (UniqueName: \"kubernetes.io/projected/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-kube-api-access-7kkv5\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.075010 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.074961 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:29.103436 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.103406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-apiservice-cert\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.103570 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.103440 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-webhook-cert\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.103570 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.103485 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kkv5\" (UniqueName: \"kubernetes.io/projected/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-kube-api-access-7kkv5\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.103570 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.103508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-manifests\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.103570 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.103537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-tmp\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.104020 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.103990 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-manifests\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.105890 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.105865 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-tmp\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.106004 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.105970 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-webhook-cert\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.106193 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.106173 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-apiservice-cert\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.112113 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.112092 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kkv5\" (UniqueName: \"kubernetes.io/projected/e9360a64-0d6b-4a6b-aae1-100e1a2d8877-kube-api-access-7kkv5\") pod \"opendatahub-operator-controller-manager-554b6949c8-dpsnp\" (UID: \"e9360a64-0d6b-4a6b-aae1-100e1a2d8877\") " pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.175289 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.175249 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:29.177112 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.177085 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:29.280933 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.280889 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:29.311967 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.311937 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp"] Jul 14 01:06:29.315217 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:06:29.315185 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9360a64_0d6b_4a6b_aae1_100e1a2d8877.slice/crio-f6107d2acf126ba53068f2aaab7cb529b1f316b4d127356c733cddb666571b54 WatchSource:0}: Error finding container f6107d2acf126ba53068f2aaab7cb529b1f316b4d127356c733cddb666571b54: Status 404 returned error can't find the container with id f6107d2acf126ba53068f2aaab7cb529b1f316b4d127356c733cddb666571b54 Jul 14 01:06:29.360249 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.360217 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" event={"ID":"e9360a64-0d6b-4a6b-aae1-100e1a2d8877","Type":"ContainerStarted","Data":"f6107d2acf126ba53068f2aaab7cb529b1f316b4d127356c733cddb666571b54"} Jul 14 01:06:29.376125 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:29.376095 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:32.336490 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:32.336457 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cb746fd84-bccnf" Jul 14 01:06:33.381738 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:33.381697 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" event={"ID":"e9360a64-0d6b-4a6b-aae1-100e1a2d8877","Type":"ContainerStarted","Data":"1036e232c14f69f4908e2afb873c09711c21ae012209193f87e7ba0c25d6b61d"} Jul 14 01:06:34.388170 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:34.388092 2570 generic.go:356] "Generic (PLEG): container finished" podID="e9360a64-0d6b-4a6b-aae1-100e1a2d8877" containerID="1036e232c14f69f4908e2afb873c09711c21ae012209193f87e7ba0c25d6b61d" exitCode=0 Jul 14 01:06:34.388170 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:34.388147 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" event={"ID":"e9360a64-0d6b-4a6b-aae1-100e1a2d8877","Type":"ContainerDied","Data":"1036e232c14f69f4908e2afb873c09711c21ae012209193f87e7ba0c25d6b61d"} Jul 14 01:06:35.394065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:35.393986 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" event={"ID":"e9360a64-0d6b-4a6b-aae1-100e1a2d8877","Type":"ContainerStarted","Data":"69b6eedeec1db3d836def8feae5d56d63c3c88d4efd891d31c3e61cd64def2e7"} Jul 14 01:06:35.394467 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:35.394160 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:35.417268 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:35.417218 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" podStartSLOduration=2.242057463 podStartE2EDuration="7.417201779s" totalImagesPullingTime="4.119951752s" totalInitContainerRuntime="1.055192564s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:06:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:06:35.415205896 +0000 UTC m=+443.285641104" watchObservedRunningTime="2026-07-14 01:06:35.417201779 +0000 UTC m=+443.287636968" Jul 14 01:06:40.864156 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:40.864118 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:40.962601 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:40.962565 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:46.401031 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:46.400997 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-554b6949c8-dpsnp" Jul 14 01:06:48.230377 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:48.230344 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:48.347348 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:48.347316 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:48.575932 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:48.575838 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:48.946634 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:48.946593 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:49.050972 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:49.050933 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:49.144186 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:49.144147 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:49.468968 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:49.468940 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:49.621623 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:49.621594 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:54.075416 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:54.075385 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:54.938984 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:54.938946 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:55.389730 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:55.389645 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:55.472424 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:55.472389 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:56.101576 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:56.101540 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:58.019734 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.019694 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:58.067209 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.067182 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5th96"] Jul 14 01:06:58.075343 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.075321 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.077910 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.077890 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 01:06:58.079158 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.079119 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fwz2f\"" Jul 14 01:06:58.081084 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.081063 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6"] Jul 14 01:06:58.084548 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.084528 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5th96"] Jul 14 01:06:58.084627 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.084613 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:58.086807 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.086785 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wr9n5\"" Jul 14 01:06:58.087154 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.087133 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 14 01:06:58.092732 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.092711 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6"] Jul 14 01:06:58.121413 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.121384 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:58.134518 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.134494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5m22\" (UniqueName: \"kubernetes.io/projected/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-kube-api-access-x5m22\") pod \"llmisvc-controller-manager-777c6bd7d5-jjjz6\" (UID: \"fca4c2f0-a91c-4606-b367-c7a5ca3106eb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:58.134627 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.134547 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jjjz6\" (UID: \"fca4c2f0-a91c-4606-b367-c7a5ca3106eb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:58.134627 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.134595 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/103e1ac5-8393-4298-b7c7-ac52a34106dc-cert\") pod \"kserve-controller-manager-d6f4b65b8-5th96\" (UID: \"103e1ac5-8393-4298-b7c7-ac52a34106dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.134693 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.134627 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs892\" (UniqueName: \"kubernetes.io/projected/103e1ac5-8393-4298-b7c7-ac52a34106dc-kube-api-access-fs892\") pod \"kserve-controller-manager-d6f4b65b8-5th96\" (UID: \"103e1ac5-8393-4298-b7c7-ac52a34106dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.235884 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.235846 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/103e1ac5-8393-4298-b7c7-ac52a34106dc-cert\") pod \"kserve-controller-manager-d6f4b65b8-5th96\" (UID: \"103e1ac5-8393-4298-b7c7-ac52a34106dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.236065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.235894 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs892\" (UniqueName: \"kubernetes.io/projected/103e1ac5-8393-4298-b7c7-ac52a34106dc-kube-api-access-fs892\") pod \"kserve-controller-manager-d6f4b65b8-5th96\" (UID: \"103e1ac5-8393-4298-b7c7-ac52a34106dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.236065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.235948 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5m22\" (UniqueName: \"kubernetes.io/projected/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-kube-api-access-x5m22\") pod \"llmisvc-controller-manager-777c6bd7d5-jjjz6\" (UID: \"fca4c2f0-a91c-4606-b367-c7a5ca3106eb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:58.236065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.235989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jjjz6\" (UID: \"fca4c2f0-a91c-4606-b367-c7a5ca3106eb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:58.236065 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:06:58.236018 2570 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 14 01:06:58.236253 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:06:58.236075 2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 14 01:06:58.236253 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:06:58.236092 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/103e1ac5-8393-4298-b7c7-ac52a34106dc-cert podName:103e1ac5-8393-4298-b7c7-ac52a34106dc nodeName:}" failed. No retries permitted until 2026-07-14 01:06:58.736073598 +0000 UTC m=+466.606508768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/103e1ac5-8393-4298-b7c7-ac52a34106dc-cert") pod "kserve-controller-manager-d6f4b65b8-5th96" (UID: "103e1ac5-8393-4298-b7c7-ac52a34106dc") : secret "kserve-webhook-server-cert" not found Jul 14 01:06:58.236253 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:06:58.236119 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-cert podName:fca4c2f0-a91c-4606-b367-c7a5ca3106eb nodeName:}" failed. No retries permitted until 2026-07-14 01:06:58.736102631 +0000 UTC m=+466.606537803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-cert") pod "llmisvc-controller-manager-777c6bd7d5-jjjz6" (UID: "fca4c2f0-a91c-4606-b367-c7a5ca3106eb") : secret "llmisvc-webhook-server-cert" not found Jul 14 01:06:58.256278 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.256248 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs892\" (UniqueName: \"kubernetes.io/projected/103e1ac5-8393-4298-b7c7-ac52a34106dc-kube-api-access-fs892\") pod \"kserve-controller-manager-d6f4b65b8-5th96\" (UID: \"103e1ac5-8393-4298-b7c7-ac52a34106dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.259546 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.259517 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5m22\" (UniqueName: \"kubernetes.io/projected/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-kube-api-access-x5m22\") pod \"llmisvc-controller-manager-777c6bd7d5-jjjz6\" (UID: \"fca4c2f0-a91c-4606-b367-c7a5ca3106eb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:58.315683 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.315594 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:58.421568 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.421535 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:58.521143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.521112 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:58.651369 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.651280 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:06:58.740283 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.740248 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jjjz6\" (UID: \"fca4c2f0-a91c-4606-b367-c7a5ca3106eb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:58.740439 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.740290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/103e1ac5-8393-4298-b7c7-ac52a34106dc-cert\") pod \"kserve-controller-manager-d6f4b65b8-5th96\" (UID: \"103e1ac5-8393-4298-b7c7-ac52a34106dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.742829 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.742801 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/103e1ac5-8393-4298-b7c7-ac52a34106dc-cert\") pod \"kserve-controller-manager-d6f4b65b8-5th96\" (UID: \"103e1ac5-8393-4298-b7c7-ac52a34106dc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.742990 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.742971 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fca4c2f0-a91c-4606-b367-c7a5ca3106eb-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jjjz6\" (UID: \"fca4c2f0-a91c-4606-b367-c7a5ca3106eb\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:58.987206 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.987164 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:06:58.995535 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:58.995512 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:06:59.164606 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:59.164584 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6"] Jul 14 01:06:59.166779 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:06:59.166757 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfca4c2f0_a91c_4606_b367_c7a5ca3106eb.slice/crio-b9a0197020b6157ceb15a76b1ade12476030b886403d1438a32a08c3e0b3d6b5 WatchSource:0}: Error finding container b9a0197020b6157ceb15a76b1ade12476030b886403d1438a32a08c3e0b3d6b5: Status 404 returned error can't find the container with id b9a0197020b6157ceb15a76b1ade12476030b886403d1438a32a08c3e0b3d6b5 Jul 14 01:06:59.334065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:59.333939 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5th96"] Jul 14 01:06:59.336654 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:06:59.336629 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod103e1ac5_8393_4298_b7c7_ac52a34106dc.slice/crio-a55c965fd590d85274e42cbeb86c6b1e0629dd24e710311c3baaea02084c9995 WatchSource:0}: Error finding container a55c965fd590d85274e42cbeb86c6b1e0629dd24e710311c3baaea02084c9995: Status 404 returned error can't find the container with id a55c965fd590d85274e42cbeb86c6b1e0629dd24e710311c3baaea02084c9995 Jul 14 01:06:59.486798 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:59.486763 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" event={"ID":"fca4c2f0-a91c-4606-b367-c7a5ca3106eb","Type":"ContainerStarted","Data":"b9a0197020b6157ceb15a76b1ade12476030b886403d1438a32a08c3e0b3d6b5"} Jul 14 01:06:59.487842 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:06:59.487817 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" event={"ID":"103e1ac5-8393-4298-b7c7-ac52a34106dc","Type":"ContainerStarted","Data":"a55c965fd590d85274e42cbeb86c6b1e0629dd24e710311c3baaea02084c9995"} Jul 14 01:07:00.003132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:00.003081 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:01.010588 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:01.010560 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:01.215726 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:01.215687 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:01.478767 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:01.478727 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:01.567457 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:01.567424 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:04.517252 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:04.517215 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" event={"ID":"103e1ac5-8393-4298-b7c7-ac52a34106dc","Type":"ContainerStarted","Data":"d31ae4e03657b1ec68d4582332e0ce24a4dff48944e79c838769f334005f590d"} Jul 14 01:07:04.517699 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:04.517282 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:07:04.518641 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:04.518616 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" event={"ID":"fca4c2f0-a91c-4606-b367-c7a5ca3106eb","Type":"ContainerStarted","Data":"376c25837ca63ae046a7ba96be7bc26cf06dbdb56583e4fd107f5c74acb7466b"} Jul 14 01:07:04.518772 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:04.518754 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:07:04.547192 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:04.547141 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" podStartSLOduration=2.197705175 podStartE2EDuration="6.547125699s" totalImagesPullingTime="4.349420524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:07:04.546095143 +0000 UTC m=+472.416530334" watchObservedRunningTime="2026-07-14 01:07:04.547125699 +0000 UTC m=+472.417560890" Jul 14 01:07:04.573589 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:04.573537 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" podStartSLOduration=2.050805025 podStartE2EDuration="6.573519085s" totalImagesPullingTime="4.52271406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:06:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:07:04.57188975 +0000 UTC m=+472.442324940" watchObservedRunningTime="2026-07-14 01:07:04.573519085 +0000 UTC m=+472.443954329" Jul 14 01:07:35.525821 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:35.525789 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jjjz6" Jul 14 01:07:35.529261 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:35.529234 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5th96" Jul 14 01:07:41.353497 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:41.353461 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:41.454514 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:41.454477 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:49.673067 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.673032 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:49.768494 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.768455 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:49.805405 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.805370 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8z9cv"] Jul 14 01:07:49.808725 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.808695 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" Jul 14 01:07:49.811203 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.811179 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 01:07:49.812105 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.812034 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qlwmm\"" Jul 14 01:07:49.812105 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.812036 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 01:07:49.817993 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.817965 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8z9cv"] Jul 14 01:07:49.957383 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:49.957294 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hcfl\" (UniqueName: \"kubernetes.io/projected/6c51c337-ca03-4eb2-89a8-093ec308a581-kube-api-access-7hcfl\") pod \"kuadrant-operator-catalog-8z9cv\" (UID: \"6c51c337-ca03-4eb2-89a8-093ec308a581\") " pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" Jul 14 01:07:50.058311 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.058266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hcfl\" (UniqueName: \"kubernetes.io/projected/6c51c337-ca03-4eb2-89a8-093ec308a581-kube-api-access-7hcfl\") pod \"kuadrant-operator-catalog-8z9cv\" (UID: \"6c51c337-ca03-4eb2-89a8-093ec308a581\") " pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" Jul 14 01:07:50.067009 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.066981 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hcfl\" (UniqueName: \"kubernetes.io/projected/6c51c337-ca03-4eb2-89a8-093ec308a581-kube-api-access-7hcfl\") pod \"kuadrant-operator-catalog-8z9cv\" (UID: \"6c51c337-ca03-4eb2-89a8-093ec308a581\") " pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" Jul 14 01:07:50.119996 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.119961 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" Jul 14 01:07:50.179375 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.179350 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8z9cv"] Jul 14 01:07:50.249447 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.249421 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8z9cv"] Jul 14 01:07:50.252071 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:07:50.252043 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c51c337_ca03_4eb2_89a8_093ec308a581.slice/crio-1a50a113f0c671fb0d8a2ee9426cdbfeeb231b67dd8cefd37beccbf2f3f055e5 WatchSource:0}: Error finding container 1a50a113f0c671fb0d8a2ee9426cdbfeeb231b67dd8cefd37beccbf2f3f055e5: Status 404 returned error can't find the container with id 1a50a113f0c671fb0d8a2ee9426cdbfeeb231b67dd8cefd37beccbf2f3f055e5 Jul 14 01:07:50.387765 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.387732 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnzx5"] Jul 14 01:07:50.392105 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.392088 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:07:50.398864 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.398837 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnzx5"] Jul 14 01:07:50.416027 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.415995 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:50.563043 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.562959 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v667v\" (UniqueName: \"kubernetes.io/projected/11a48606-bc0c-4e53-b3b9-7cbb6f6444e6-kube-api-access-v667v\") pod \"kuadrant-operator-catalog-bnzx5\" (UID: \"11a48606-bc0c-4e53-b3b9-7cbb6f6444e6\") " pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:07:50.609843 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.609809 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:50.663975 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.663944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v667v\" (UniqueName: \"kubernetes.io/projected/11a48606-bc0c-4e53-b3b9-7cbb6f6444e6-kube-api-access-v667v\") pod \"kuadrant-operator-catalog-bnzx5\" (UID: \"11a48606-bc0c-4e53-b3b9-7cbb6f6444e6\") " pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:07:50.674237 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.674214 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v667v\" (UniqueName: \"kubernetes.io/projected/11a48606-bc0c-4e53-b3b9-7cbb6f6444e6-kube-api-access-v667v\") pod \"kuadrant-operator-catalog-bnzx5\" (UID: \"11a48606-bc0c-4e53-b3b9-7cbb6f6444e6\") " pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:07:50.703212 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.703184 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:07:50.707768 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.707743 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" event={"ID":"6c51c337-ca03-4eb2-89a8-093ec308a581","Type":"ContainerStarted","Data":"1a50a113f0c671fb0d8a2ee9426cdbfeeb231b67dd8cefd37beccbf2f3f055e5"} Jul 14 01:07:50.812518 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.812482 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:07:50.834100 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:50.834031 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bnzx5"] Jul 14 01:07:50.837051 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:07:50.837024 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a48606_bc0c_4e53_b3b9_7cbb6f6444e6.slice/crio-2cab8474f6c2086b66aa56ed7069095653ef34c5877677a47b93e1b965c51902 WatchSource:0}: Error finding container 2cab8474f6c2086b66aa56ed7069095653ef34c5877677a47b93e1b965c51902: Status 404 returned error can't find the container with id 2cab8474f6c2086b66aa56ed7069095653ef34c5877677a47b93e1b965c51902 Jul 14 01:07:51.714931 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:51.714881 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" event={"ID":"11a48606-bc0c-4e53-b3b9-7cbb6f6444e6","Type":"ContainerStarted","Data":"2cab8474f6c2086b66aa56ed7069095653ef34c5877677a47b93e1b965c51902"} Jul 14 01:07:53.728516 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:53.728474 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" event={"ID":"6c51c337-ca03-4eb2-89a8-093ec308a581","Type":"ContainerStarted","Data":"9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e"} Jul 14 01:07:53.729013 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:53.728550 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" podUID="6c51c337-ca03-4eb2-89a8-093ec308a581" containerName="registry-server" containerID="cri-o://9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e" gracePeriod=2 Jul 14 01:07:53.730368 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:53.730332 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" event={"ID":"11a48606-bc0c-4e53-b3b9-7cbb6f6444e6","Type":"ContainerStarted","Data":"f57ed5a577b65c50e5a36dea780cfc96fc39de78468ce3847f1ab4517205a777"} Jul 14 01:07:53.745232 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:53.745191 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" podStartSLOduration=2.279064122 podStartE2EDuration="4.745176606s" totalImagesPullingTime="2.466112484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:07:53.742995166 +0000 UTC m=+521.613430383" watchObservedRunningTime="2026-07-14 01:07:53.745176606 +0000 UTC m=+521.615611797" Jul 14 01:07:53.757605 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:53.757562 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" podStartSLOduration=1.8735587420000002 podStartE2EDuration="3.757547136s" totalImagesPullingTime="1.883988394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:07:53.755787643 +0000 UTC m=+521.626222836" watchObservedRunningTime="2026-07-14 01:07:53.757547136 +0000 UTC m=+521.627982326" Jul 14 01:07:53.761339 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:07:53.761315 2570 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c51c337_ca03_4eb2_89a8_093ec308a581.slice/crio-9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e.scope\": RecentStats: unable to find data in memory cache]" Jul 14 01:07:53.965037 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:53.965007 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" Jul 14 01:07:54.091164 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.091078 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hcfl\" (UniqueName: \"kubernetes.io/projected/6c51c337-ca03-4eb2-89a8-093ec308a581-kube-api-access-7hcfl\") pod \"6c51c337-ca03-4eb2-89a8-093ec308a581\" (UID: \"6c51c337-ca03-4eb2-89a8-093ec308a581\") " Jul 14 01:07:54.093381 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.093352 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c51c337-ca03-4eb2-89a8-093ec308a581-kube-api-access-7hcfl" (OuterVolumeSpecName: "kube-api-access-7hcfl") pod "6c51c337-ca03-4eb2-89a8-093ec308a581" (UID: "6c51c337-ca03-4eb2-89a8-093ec308a581"). InnerVolumeSpecName "kube-api-access-7hcfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:07:54.192625 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.192593 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hcfl\" (UniqueName: \"kubernetes.io/projected/6c51c337-ca03-4eb2-89a8-093ec308a581-kube-api-access-7hcfl\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:07:54.735861 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.735822 2570 generic.go:356] "Generic (PLEG): container finished" podID="6c51c337-ca03-4eb2-89a8-093ec308a581" containerID="9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e" exitCode=0 Jul 14 01:07:54.735861 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.735861 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" Jul 14 01:07:54.736323 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.735907 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" event={"ID":"6c51c337-ca03-4eb2-89a8-093ec308a581","Type":"ContainerDied","Data":"9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e"} Jul 14 01:07:54.736323 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.735965 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8z9cv" event={"ID":"6c51c337-ca03-4eb2-89a8-093ec308a581","Type":"ContainerDied","Data":"1a50a113f0c671fb0d8a2ee9426cdbfeeb231b67dd8cefd37beccbf2f3f055e5"} Jul 14 01:07:54.736323 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.735992 2570 scope.go:117] "RemoveContainer" containerID="9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e" Jul 14 01:07:54.744784 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.744765 2570 scope.go:117] "RemoveContainer" containerID="9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e" Jul 14 01:07:54.745034 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:07:54.745012 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e\": container with ID starting with 9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e not found: ID does not exist" containerID="9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e" Jul 14 01:07:54.745102 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.745047 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e"} err="failed to get container status \"9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e\": rpc error: code = NotFound desc = could not find container \"9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e\": container with ID starting with 9404b130398f732db23cfb8bd73761d35066ad6e5c6981b9bcd3b3f417c1784e not found: ID does not exist" Jul 14 01:07:54.751947 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.751907 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8z9cv"] Jul 14 01:07:54.755598 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:54.755576 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8z9cv"] Jul 14 01:07:56.664641 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:07:56.664607 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c51c337-ca03-4eb2-89a8-093ec308a581" path="/var/lib/kubelet/pods/6c51c337-ca03-4eb2-89a8-093ec308a581/volumes" Jul 14 01:08:00.703988 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:00.703946 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:08:00.704406 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:00.704010 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:08:00.726348 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:00.726321 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:08:00.783632 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:00.783605 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-bnzx5" Jul 14 01:08:02.217786 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.217750 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq"] Jul 14 01:08:02.218185 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.218087 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c51c337-ca03-4eb2-89a8-093ec308a581" containerName="registry-server" Jul 14 01:08:02.218185 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.218099 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c51c337-ca03-4eb2-89a8-093ec308a581" containerName="registry-server" Jul 14 01:08:02.218185 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.218150 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c51c337-ca03-4eb2-89a8-093ec308a581" containerName="registry-server" Jul 14 01:08:02.224653 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.224625 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.227682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.227652 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rc5dh\"" Jul 14 01:08:02.228832 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.228797 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq"] Jul 14 01:08:02.257936 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.257882 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.258067 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.257981 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvmbv\" (UniqueName: \"kubernetes.io/projected/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-kube-api-access-cvmbv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.258117 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.258058 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.359316 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.359279 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.359469 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.359328 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.359469 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.359372 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvmbv\" (UniqueName: \"kubernetes.io/projected/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-kube-api-access-cvmbv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.359647 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.359628 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.359684 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.359665 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.367426 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.367396 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvmbv\" (UniqueName: \"kubernetes.io/projected/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-kube-api-access-cvmbv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.535514 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.535421 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:02.667162 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.667127 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq"] Jul 14 01:08:02.668241 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:08:02.668215 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2e72ba_9f10_48fc_acb5_f5495a4edd8a.slice/crio-d689795ca768031c944e08abf14fc7fb57c0aa3e039ad784afb564ffa634e63c WatchSource:0}: Error finding container d689795ca768031c944e08abf14fc7fb57c0aa3e039ad784afb564ffa634e63c: Status 404 returned error can't find the container with id d689795ca768031c944e08abf14fc7fb57c0aa3e039ad784afb564ffa634e63c Jul 14 01:08:02.770781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.770748 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" event={"ID":"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a","Type":"ContainerStarted","Data":"fd7bc42b590aa7993042ebdd8c2d1828ef8655f93ff9231d449e141c913d5fb1"} Jul 14 01:08:02.770889 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:02.770807 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" event={"ID":"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a","Type":"ContainerStarted","Data":"d689795ca768031c944e08abf14fc7fb57c0aa3e039ad784afb564ffa634e63c"} Jul 14 01:08:03.020779 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.020744 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw"] Jul 14 01:08:03.024181 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.024162 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.031786 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.031764 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw"] Jul 14 01:08:03.063595 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.063559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.063741 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.063606 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.063741 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.063648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml8tq\" (UniqueName: \"kubernetes.io/projected/61106380-5fde-48e4-a4ca-b2a597642e38-kube-api-access-ml8tq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.164212 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.164178 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml8tq\" (UniqueName: \"kubernetes.io/projected/61106380-5fde-48e4-a4ca-b2a597642e38-kube-api-access-ml8tq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.164371 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.164233 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.164371 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.164268 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.164574 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.164559 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.164619 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.164589 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.171700 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.171674 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml8tq\" (UniqueName: \"kubernetes.io/projected/61106380-5fde-48e4-a4ca-b2a597642e38-kube-api-access-ml8tq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.333905 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.333808 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:03.461880 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.461859 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw"] Jul 14 01:08:03.464479 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:08:03.464451 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61106380_5fde_48e4_a4ca_b2a597642e38.slice/crio-d5c2f4091cf2564c31e60fe52fb785d30466b256902ec64b57bb7f624e7613e7 WatchSource:0}: Error finding container d5c2f4091cf2564c31e60fe52fb785d30466b256902ec64b57bb7f624e7613e7: Status 404 returned error can't find the container with id d5c2f4091cf2564c31e60fe52fb785d30466b256902ec64b57bb7f624e7613e7 Jul 14 01:08:03.617786 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.617723 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx"] Jul 14 01:08:03.621072 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.621057 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.629733 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.629548 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx"] Jul 14 01:08:03.667196 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.667166 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4pl8\" (UniqueName: \"kubernetes.io/projected/b1912e55-3f7e-48e6-928e-1bf11a4630fc-kube-api-access-f4pl8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.667318 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.667222 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.667318 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.667267 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.768282 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.768242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4pl8\" (UniqueName: \"kubernetes.io/projected/b1912e55-3f7e-48e6-928e-1bf11a4630fc-kube-api-access-f4pl8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.768450 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.768301 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.768450 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.768331 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.768729 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.768709 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.768771 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.768725 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.776142 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.776119 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4pl8\" (UniqueName: \"kubernetes.io/projected/b1912e55-3f7e-48e6-928e-1bf11a4630fc-kube-api-access-f4pl8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:03.777307 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.777285 2570 generic.go:356] "Generic (PLEG): container finished" podID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerID="fd7bc42b590aa7993042ebdd8c2d1828ef8655f93ff9231d449e141c913d5fb1" exitCode=0 Jul 14 01:08:03.777413 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.777368 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" event={"ID":"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a","Type":"ContainerDied","Data":"fd7bc42b590aa7993042ebdd8c2d1828ef8655f93ff9231d449e141c913d5fb1"} Jul 14 01:08:03.779013 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.778987 2570 generic.go:356] "Generic (PLEG): container finished" podID="61106380-5fde-48e4-a4ca-b2a597642e38" containerID="696586551b19df961482eb866031dfbff48df98e80671e464b17135a8c2eec85" exitCode=0 Jul 14 01:08:03.779121 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.779017 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" event={"ID":"61106380-5fde-48e4-a4ca-b2a597642e38","Type":"ContainerDied","Data":"696586551b19df961482eb866031dfbff48df98e80671e464b17135a8c2eec85"} Jul 14 01:08:03.779121 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.779055 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" event={"ID":"61106380-5fde-48e4-a4ca-b2a597642e38","Type":"ContainerStarted","Data":"d5c2f4091cf2564c31e60fe52fb785d30466b256902ec64b57bb7f624e7613e7"} Jul 14 01:08:03.932474 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:03.932433 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:04.071616 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.071563 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx"] Jul 14 01:08:04.073776 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:08:04.073746 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1912e55_3f7e_48e6_928e_1bf11a4630fc.slice/crio-aa6c4173a2d7327600a5c50a43f79471662bc2db78aa4eff632460b7c1fb56d2 WatchSource:0}: Error finding container aa6c4173a2d7327600a5c50a43f79471662bc2db78aa4eff632460b7c1fb56d2: Status 404 returned error can't find the container with id aa6c4173a2d7327600a5c50a43f79471662bc2db78aa4eff632460b7c1fb56d2 Jul 14 01:08:04.217312 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.217213 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6"] Jul 14 01:08:04.220735 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.220713 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.229101 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.229056 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6"] Jul 14 01:08:04.272210 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.272175 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.272210 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.272225 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t2nm\" (UniqueName: \"kubernetes.io/projected/3de2ac91-9553-4478-82a7-cfe066f2ccb9-kube-api-access-8t2nm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.272444 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.272275 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.373229 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.373187 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t2nm\" (UniqueName: \"kubernetes.io/projected/3de2ac91-9553-4478-82a7-cfe066f2ccb9-kube-api-access-8t2nm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.373678 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.373289 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.373678 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.373369 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.373802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.373770 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.373846 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.373803 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.381613 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.381578 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t2nm\" (UniqueName: \"kubernetes.io/projected/3de2ac91-9553-4478-82a7-cfe066f2ccb9-kube-api-access-8t2nm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.544648 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.544547 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:04.726130 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.726099 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6"] Jul 14 01:08:04.727942 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:08:04.727899 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de2ac91_9553_4478_82a7_cfe066f2ccb9.slice/crio-c656f41f4d04daff4e835b49bc5cd6462605e171731d7606810d9c5753dec406 WatchSource:0}: Error finding container c656f41f4d04daff4e835b49bc5cd6462605e171731d7606810d9c5753dec406: Status 404 returned error can't find the container with id c656f41f4d04daff4e835b49bc5cd6462605e171731d7606810d9c5753dec406 Jul 14 01:08:04.786169 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.786136 2570 generic.go:356] "Generic (PLEG): container finished" podID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerID="c7d0b998e30dba2a2371e3365ff40c925fdad6d94e2dbf3fb44cf15dc2245bbb" exitCode=0 Jul 14 01:08:04.786370 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.786223 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" event={"ID":"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a","Type":"ContainerDied","Data":"c7d0b998e30dba2a2371e3365ff40c925fdad6d94e2dbf3fb44cf15dc2245bbb"} Jul 14 01:08:04.787688 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.787659 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" event={"ID":"3de2ac91-9553-4478-82a7-cfe066f2ccb9","Type":"ContainerStarted","Data":"c656f41f4d04daff4e835b49bc5cd6462605e171731d7606810d9c5753dec406"} Jul 14 01:08:04.789414 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.789387 2570 generic.go:356] "Generic (PLEG): container finished" podID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerID="dd7169b12160206f6768ade25f9ec6c03abd11aae3b858fa446d7865e5845c61" exitCode=0 Jul 14 01:08:04.789499 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.789449 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" event={"ID":"b1912e55-3f7e-48e6-928e-1bf11a4630fc","Type":"ContainerDied","Data":"dd7169b12160206f6768ade25f9ec6c03abd11aae3b858fa446d7865e5845c61"} Jul 14 01:08:04.789499 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:04.789490 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" event={"ID":"b1912e55-3f7e-48e6-928e-1bf11a4630fc","Type":"ContainerStarted","Data":"aa6c4173a2d7327600a5c50a43f79471662bc2db78aa4eff632460b7c1fb56d2"} Jul 14 01:08:05.795807 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:05.795771 2570 generic.go:356] "Generic (PLEG): container finished" podID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerID="f3a0075943584c6c823e1b9448775f5993468aa5671434d579521ae330043719" exitCode=0 Jul 14 01:08:05.796275 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:05.795873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" event={"ID":"3de2ac91-9553-4478-82a7-cfe066f2ccb9","Type":"ContainerDied","Data":"f3a0075943584c6c823e1b9448775f5993468aa5671434d579521ae330043719"} Jul 14 01:08:05.797663 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:05.797642 2570 generic.go:356] "Generic (PLEG): container finished" podID="61106380-5fde-48e4-a4ca-b2a597642e38" containerID="d88251c936f6aa567374fead35c8721315decf589f6998aa043f8ea0a4ff0b48" exitCode=0 Jul 14 01:08:05.797767 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:05.797730 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" event={"ID":"61106380-5fde-48e4-a4ca-b2a597642e38","Type":"ContainerDied","Data":"d88251c936f6aa567374fead35c8721315decf589f6998aa043f8ea0a4ff0b48"} Jul 14 01:08:05.799951 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:05.799931 2570 generic.go:356] "Generic (PLEG): container finished" podID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerID="345f2e0c1842a1301facd0d1cc7a893ea26bf720b3c199579c7dbe1fbf4e82fe" exitCode=0 Jul 14 01:08:05.800021 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:05.799961 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" event={"ID":"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a","Type":"ContainerDied","Data":"345f2e0c1842a1301facd0d1cc7a893ea26bf720b3c199579c7dbe1fbf4e82fe"} Jul 14 01:08:06.806150 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.806119 2570 generic.go:356] "Generic (PLEG): container finished" podID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerID="8a4869174d4dd5c1d55cc5dab3620c5caa5c57f95f0c463735d3f664820a52c7" exitCode=0 Jul 14 01:08:06.806599 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.806197 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" event={"ID":"3de2ac91-9553-4478-82a7-cfe066f2ccb9","Type":"ContainerDied","Data":"8a4869174d4dd5c1d55cc5dab3620c5caa5c57f95f0c463735d3f664820a52c7"} Jul 14 01:08:06.808145 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.808122 2570 generic.go:356] "Generic (PLEG): container finished" podID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerID="28d75c1fe5b7995ad5c621edecb064d6957da43677e9e51ad3042a7aceebfd6f" exitCode=0 Jul 14 01:08:06.808248 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.808151 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" event={"ID":"b1912e55-3f7e-48e6-928e-1bf11a4630fc","Type":"ContainerDied","Data":"28d75c1fe5b7995ad5c621edecb064d6957da43677e9e51ad3042a7aceebfd6f"} Jul 14 01:08:06.810617 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.810599 2570 generic.go:356] "Generic (PLEG): container finished" podID="61106380-5fde-48e4-a4ca-b2a597642e38" containerID="d0706fd2bcaa90edaac78acead8dc48ce08ca8cec45997217723122afab1b618" exitCode=0 Jul 14 01:08:06.810698 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.810679 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" event={"ID":"61106380-5fde-48e4-a4ca-b2a597642e38","Type":"ContainerDied","Data":"d0706fd2bcaa90edaac78acead8dc48ce08ca8cec45997217723122afab1b618"} Jul 14 01:08:06.947195 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.947172 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:06.996724 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.996692 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-bundle\") pod \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " Jul 14 01:08:06.996724 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.996726 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-util\") pod \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " Jul 14 01:08:06.996951 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.996791 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvmbv\" (UniqueName: \"kubernetes.io/projected/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-kube-api-access-cvmbv\") pod \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\" (UID: \"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a\") " Jul 14 01:08:06.997310 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.997280 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-bundle" (OuterVolumeSpecName: "bundle") pod "ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" (UID: "ca2e72ba-9f10-48fc-acb5-f5495a4edd8a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:06.998850 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:06.998827 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-kube-api-access-cvmbv" (OuterVolumeSpecName: "kube-api-access-cvmbv") pod "ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" (UID: "ca2e72ba-9f10-48fc-acb5-f5495a4edd8a"). InnerVolumeSpecName "kube-api-access-cvmbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:08:07.002534 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.002499 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-util" (OuterVolumeSpecName: "util") pod "ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" (UID: "ca2e72ba-9f10-48fc-acb5-f5495a4edd8a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:07.097661 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.097634 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvmbv\" (UniqueName: \"kubernetes.io/projected/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-kube-api-access-cvmbv\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:07.097661 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.097660 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-bundle\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:07.097818 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.097669 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca2e72ba-9f10-48fc-acb5-f5495a4edd8a-util\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:07.818732 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.818699 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" Jul 14 01:08:07.818732 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.818709 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq" event={"ID":"ca2e72ba-9f10-48fc-acb5-f5495a4edd8a","Type":"ContainerDied","Data":"d689795ca768031c944e08abf14fc7fb57c0aa3e039ad784afb564ffa634e63c"} Jul 14 01:08:07.819259 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.818750 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d689795ca768031c944e08abf14fc7fb57c0aa3e039ad784afb564ffa634e63c" Jul 14 01:08:07.820758 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.820731 2570 generic.go:356] "Generic (PLEG): container finished" podID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerID="9d6f5eac5d249ec2bb10a2a5d22a7ea0cb86aaa30197c982eaea2eb9fa58f9a4" exitCode=0 Jul 14 01:08:07.820900 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.820816 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" event={"ID":"3de2ac91-9553-4478-82a7-cfe066f2ccb9","Type":"ContainerDied","Data":"9d6f5eac5d249ec2bb10a2a5d22a7ea0cb86aaa30197c982eaea2eb9fa58f9a4"} Jul 14 01:08:07.822778 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.822755 2570 generic.go:356] "Generic (PLEG): container finished" podID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerID="3d28719d7a3806c56a5a4a4fa47b995cf90c6038c2f4c35fea69d6ae4db3661b" exitCode=0 Jul 14 01:08:07.822874 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.822807 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" event={"ID":"b1912e55-3f7e-48e6-928e-1bf11a4630fc","Type":"ContainerDied","Data":"3d28719d7a3806c56a5a4a4fa47b995cf90c6038c2f4c35fea69d6ae4db3661b"} Jul 14 01:08:07.956345 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:07.956319 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:08.007074 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.007040 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-util\") pod \"61106380-5fde-48e4-a4ca-b2a597642e38\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " Jul 14 01:08:08.007074 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.007080 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-bundle\") pod \"61106380-5fde-48e4-a4ca-b2a597642e38\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " Jul 14 01:08:08.007271 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.007102 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml8tq\" (UniqueName: \"kubernetes.io/projected/61106380-5fde-48e4-a4ca-b2a597642e38-kube-api-access-ml8tq\") pod \"61106380-5fde-48e4-a4ca-b2a597642e38\" (UID: \"61106380-5fde-48e4-a4ca-b2a597642e38\") " Jul 14 01:08:08.007562 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.007528 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-bundle" (OuterVolumeSpecName: "bundle") pod "61106380-5fde-48e4-a4ca-b2a597642e38" (UID: "61106380-5fde-48e4-a4ca-b2a597642e38"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:08.009525 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.009500 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61106380-5fde-48e4-a4ca-b2a597642e38-kube-api-access-ml8tq" (OuterVolumeSpecName: "kube-api-access-ml8tq") pod "61106380-5fde-48e4-a4ca-b2a597642e38" (UID: "61106380-5fde-48e4-a4ca-b2a597642e38"). InnerVolumeSpecName "kube-api-access-ml8tq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:08:08.012407 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.012373 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-util" (OuterVolumeSpecName: "util") pod "61106380-5fde-48e4-a4ca-b2a597642e38" (UID: "61106380-5fde-48e4-a4ca-b2a597642e38"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:08.108421 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.108389 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-util\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:08.108421 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.108416 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61106380-5fde-48e4-a4ca-b2a597642e38-bundle\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:08.108421 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.108425 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml8tq\" (UniqueName: \"kubernetes.io/projected/61106380-5fde-48e4-a4ca-b2a597642e38-kube-api-access-ml8tq\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:08.829280 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.829238 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" event={"ID":"61106380-5fde-48e4-a4ca-b2a597642e38","Type":"ContainerDied","Data":"d5c2f4091cf2564c31e60fe52fb785d30466b256902ec64b57bb7f624e7613e7"} Jul 14 01:08:08.829280 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.829273 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw" Jul 14 01:08:08.829719 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.829296 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5c2f4091cf2564c31e60fe52fb785d30466b256902ec64b57bb7f624e7613e7" Jul 14 01:08:08.959958 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.959932 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:08.991796 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:08.991771 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:09.016083 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.016055 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t2nm\" (UniqueName: \"kubernetes.io/projected/3de2ac91-9553-4478-82a7-cfe066f2ccb9-kube-api-access-8t2nm\") pod \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " Jul 14 01:08:09.016219 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.016098 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4pl8\" (UniqueName: \"kubernetes.io/projected/b1912e55-3f7e-48e6-928e-1bf11a4630fc-kube-api-access-f4pl8\") pod \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " Jul 14 01:08:09.016219 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.016143 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-bundle\") pod \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " Jul 14 01:08:09.016219 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.016168 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-util\") pod \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " Jul 14 01:08:09.016219 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.016206 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-bundle\") pod \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\" (UID: \"b1912e55-3f7e-48e6-928e-1bf11a4630fc\") " Jul 14 01:08:09.016427 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.016236 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-util\") pod \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\" (UID: \"3de2ac91-9553-4478-82a7-cfe066f2ccb9\") " Jul 14 01:08:09.016843 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.016808 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-bundle" (OuterVolumeSpecName: "bundle") pod "b1912e55-3f7e-48e6-928e-1bf11a4630fc" (UID: "b1912e55-3f7e-48e6-928e-1bf11a4630fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:09.017012 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.016986 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-bundle" (OuterVolumeSpecName: "bundle") pod "3de2ac91-9553-4478-82a7-cfe066f2ccb9" (UID: "3de2ac91-9553-4478-82a7-cfe066f2ccb9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:09.018800 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.018772 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1912e55-3f7e-48e6-928e-1bf11a4630fc-kube-api-access-f4pl8" (OuterVolumeSpecName: "kube-api-access-f4pl8") pod "b1912e55-3f7e-48e6-928e-1bf11a4630fc" (UID: "b1912e55-3f7e-48e6-928e-1bf11a4630fc"). InnerVolumeSpecName "kube-api-access-f4pl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:08:09.018906 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.018804 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de2ac91-9553-4478-82a7-cfe066f2ccb9-kube-api-access-8t2nm" (OuterVolumeSpecName: "kube-api-access-8t2nm") pod "3de2ac91-9553-4478-82a7-cfe066f2ccb9" (UID: "3de2ac91-9553-4478-82a7-cfe066f2ccb9"). InnerVolumeSpecName "kube-api-access-8t2nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:08:09.023247 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.023225 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-util" (OuterVolumeSpecName: "util") pod "b1912e55-3f7e-48e6-928e-1bf11a4630fc" (UID: "b1912e55-3f7e-48e6-928e-1bf11a4630fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:09.023720 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.023574 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-util" (OuterVolumeSpecName: "util") pod "3de2ac91-9553-4478-82a7-cfe066f2ccb9" (UID: "3de2ac91-9553-4478-82a7-cfe066f2ccb9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:09.117526 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.117496 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4pl8\" (UniqueName: \"kubernetes.io/projected/b1912e55-3f7e-48e6-928e-1bf11a4630fc-kube-api-access-f4pl8\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:09.117526 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.117521 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-bundle\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:09.117526 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.117530 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-util\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:09.117729 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.117537 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b1912e55-3f7e-48e6-928e-1bf11a4630fc-bundle\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:09.117729 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.117544 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3de2ac91-9553-4478-82a7-cfe066f2ccb9-util\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:09.117729 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.117552 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t2nm\" (UniqueName: \"kubernetes.io/projected/3de2ac91-9553-4478-82a7-cfe066f2ccb9-kube-api-access-8t2nm\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:09.835690 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.835664 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" Jul 14 01:08:09.836144 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.835644 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6" event={"ID":"3de2ac91-9553-4478-82a7-cfe066f2ccb9","Type":"ContainerDied","Data":"c656f41f4d04daff4e835b49bc5cd6462605e171731d7606810d9c5753dec406"} Jul 14 01:08:09.836144 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.835790 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c656f41f4d04daff4e835b49bc5cd6462605e171731d7606810d9c5753dec406" Jul 14 01:08:09.837643 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.837623 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" event={"ID":"b1912e55-3f7e-48e6-928e-1bf11a4630fc","Type":"ContainerDied","Data":"aa6c4173a2d7327600a5c50a43f79471662bc2db78aa4eff632460b7c1fb56d2"} Jul 14 01:08:09.837771 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.837659 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa6c4173a2d7327600a5c50a43f79471662bc2db78aa4eff632460b7c1fb56d2" Jul 14 01:08:09.837771 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:09.837626 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx" Jul 14 01:08:15.868232 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:15.868199 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:19.652867 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:19.652827 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:20.756132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756092 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd"] Jul 14 01:08:20.756574 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756524 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerName="util" Jul 14 01:08:20.756574 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756542 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerName="util" Jul 14 01:08:20.756574 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756556 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerName="pull" Jul 14 01:08:20.756574 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756563 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerName="pull" Jul 14 01:08:20.756574 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756575 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61106380-5fde-48e4-a4ca-b2a597642e38" containerName="pull" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756585 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="61106380-5fde-48e4-a4ca-b2a597642e38" containerName="pull" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756595 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerName="pull" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756602 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerName="pull" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756615 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerName="util" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756623 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerName="util" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756640 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerName="util" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756647 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerName="util" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756657 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerName="pull" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756666 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerName="pull" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756674 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756682 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756691 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756699 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756708 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756717 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756726 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61106380-5fde-48e4-a4ca-b2a597642e38" containerName="util" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756733 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="61106380-5fde-48e4-a4ca-b2a597642e38" containerName="util" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756745 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61106380-5fde-48e4-a4ca-b2a597642e38" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756752 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="61106380-5fde-48e4-a4ca-b2a597642e38" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756836 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2e72ba-9f10-48fc-acb5-f5495a4edd8a" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756848 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1912e55-3f7e-48e6-928e-1bf11a4630fc" containerName="extract" Jul 14 01:08:20.756854 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756859 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="61106380-5fde-48e4-a4ca-b2a597642e38" containerName="extract" Jul 14 01:08:20.757802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.756869 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3de2ac91-9553-4478-82a7-cfe066f2ccb9" containerName="extract" Jul 14 01:08:20.761579 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.761558 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:20.764161 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.764136 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x947v\"" Jul 14 01:08:20.772340 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.772315 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd"] Jul 14 01:08:20.808274 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.808245 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj28z\" (UniqueName: \"kubernetes.io/projected/e13b82f7-a488-40fc-b618-70eae1153deb-kube-api-access-tj28z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" (UID: \"e13b82f7-a488-40fc-b618-70eae1153deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:20.808412 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.808287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13b82f7-a488-40fc-b618-70eae1153deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" (UID: \"e13b82f7-a488-40fc-b618-70eae1153deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:20.908798 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.908766 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13b82f7-a488-40fc-b618-70eae1153deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" (UID: \"e13b82f7-a488-40fc-b618-70eae1153deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:20.908999 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.908885 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj28z\" (UniqueName: \"kubernetes.io/projected/e13b82f7-a488-40fc-b618-70eae1153deb-kube-api-access-tj28z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" (UID: \"e13b82f7-a488-40fc-b618-70eae1153deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:20.909180 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.909152 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13b82f7-a488-40fc-b618-70eae1153deb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" (UID: \"e13b82f7-a488-40fc-b618-70eae1153deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:20.922651 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:20.922616 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj28z\" (UniqueName: \"kubernetes.io/projected/e13b82f7-a488-40fc-b618-70eae1153deb-kube-api-access-tj28z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" (UID: \"e13b82f7-a488-40fc-b618-70eae1153deb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:21.072820 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:21.072718 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:21.210470 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:21.210437 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd"] Jul 14 01:08:21.212404 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:08:21.212378 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13b82f7_a488_40fc_b618_70eae1153deb.slice/crio-09e39ab24473f6adf9ad6573bac8faf135749c32f7851419ce6aa0ea4457dd55 WatchSource:0}: Error finding container 09e39ab24473f6adf9ad6573bac8faf135749c32f7851419ce6aa0ea4457dd55: Status 404 returned error can't find the container with id 09e39ab24473f6adf9ad6573bac8faf135749c32f7851419ce6aa0ea4457dd55 Jul 14 01:08:21.236166 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:21.236133 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:21.810014 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:21.809970 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:21.890747 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:21.890715 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" event={"ID":"e13b82f7-a488-40fc-b618-70eae1153deb","Type":"ContainerStarted","Data":"09e39ab24473f6adf9ad6573bac8faf135749c32f7851419ce6aa0ea4457dd55"} Jul 14 01:08:25.430099 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:25.430041 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:28.431114 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:28.431071 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:28.927441 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:28.927406 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" event={"ID":"e13b82f7-a488-40fc-b618-70eae1153deb","Type":"ContainerStarted","Data":"08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc"} Jul 14 01:08:28.927622 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:28.927487 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:28.948281 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:28.948239 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" podStartSLOduration=1.729612291 podStartE2EDuration="8.948225222s" totalImagesPullingTime="7.218612931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:28.94536303 +0000 UTC m=+556.815798235" watchObservedRunningTime="2026-07-14 01:08:28.948225222 +0000 UTC m=+556.818660412" Jul 14 01:08:30.422505 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.422469 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg"] Jul 14 01:08:30.426000 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.425980 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" Jul 14 01:08:30.428516 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.428492 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r9s8f\"" Jul 14 01:08:30.428516 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.428515 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 01:08:30.435558 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.435532 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg"] Jul 14 01:08:30.493775 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.493739 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvxkb\" (UniqueName: \"kubernetes.io/projected/0446cde6-acf6-4c19-a867-d9c723825ce1-kube-api-access-tvxkb\") pod \"dns-operator-controller-manager-864dd78c4c-hrdxg\" (UID: \"0446cde6-acf6-4c19-a867-d9c723825ce1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" Jul 14 01:08:30.595110 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.595075 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvxkb\" (UniqueName: \"kubernetes.io/projected/0446cde6-acf6-4c19-a867-d9c723825ce1-kube-api-access-tvxkb\") pod \"dns-operator-controller-manager-864dd78c4c-hrdxg\" (UID: \"0446cde6-acf6-4c19-a867-d9c723825ce1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" Jul 14 01:08:30.603664 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.603637 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvxkb\" (UniqueName: \"kubernetes.io/projected/0446cde6-acf6-4c19-a867-d9c723825ce1-kube-api-access-tvxkb\") pod \"dns-operator-controller-manager-864dd78c4c-hrdxg\" (UID: \"0446cde6-acf6-4c19-a867-d9c723825ce1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" Jul 14 01:08:30.737071 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.736995 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" Jul 14 01:08:30.880079 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.880054 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg"] Jul 14 01:08:30.882731 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:08:30.882704 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0446cde6_acf6_4c19_a867_d9c723825ce1.slice/crio-f1e90c2cb6049ae17f88957d7bda3b9edda8063239003546744063ed21db925e WatchSource:0}: Error finding container f1e90c2cb6049ae17f88957d7bda3b9edda8063239003546744063ed21db925e: Status 404 returned error can't find the container with id f1e90c2cb6049ae17f88957d7bda3b9edda8063239003546744063ed21db925e Jul 14 01:08:30.937672 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:30.937633 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" event={"ID":"0446cde6-acf6-4c19-a867-d9c723825ce1","Type":"ContainerStarted","Data":"f1e90c2cb6049ae17f88957d7bda3b9edda8063239003546744063ed21db925e"} Jul 14 01:08:31.318951 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.318901 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb"] Jul 14 01:08:31.323377 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.323357 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.325759 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.325736 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 01:08:31.325870 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.325840 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 01:08:31.325870 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.325840 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rc5dh\"" Jul 14 01:08:31.333543 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.333517 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb"] Jul 14 01:08:31.402005 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.401971 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4141c1e0-a0c0-4574-989f-f577f6403603-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.402164 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.402090 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4141c1e0-a0c0-4574-989f-f577f6403603-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.402164 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.402119 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkp7v\" (UniqueName: \"kubernetes.io/projected/4141c1e0-a0c0-4574-989f-f577f6403603-kube-api-access-qkp7v\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.503254 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.503213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4141c1e0-a0c0-4574-989f-f577f6403603-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.503254 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.503257 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkp7v\" (UniqueName: \"kubernetes.io/projected/4141c1e0-a0c0-4574-989f-f577f6403603-kube-api-access-qkp7v\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.503775 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.503280 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4141c1e0-a0c0-4574-989f-f577f6403603-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.504091 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.504065 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4141c1e0-a0c0-4574-989f-f577f6403603-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.505901 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.505879 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4141c1e0-a0c0-4574-989f-f577f6403603-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.515597 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.515572 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkp7v\" (UniqueName: \"kubernetes.io/projected/4141c1e0-a0c0-4574-989f-f577f6403603-kube-api-access-qkp7v\") pod \"kuadrant-console-plugin-66b5774985-pstxb\" (UID: \"4141c1e0-a0c0-4574-989f-f577f6403603\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.633354 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.633284 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" Jul 14 01:08:31.769459 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.769429 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb"] Jul 14 01:08:31.770540 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:08:31.770515 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4141c1e0_a0c0_4574_989f_f577f6403603.slice/crio-b064d8ac66c61743cd3feb6f2c97bb79a4e36dc81292eb2cc5b31e1b84c738b2 WatchSource:0}: Error finding container b064d8ac66c61743cd3feb6f2c97bb79a4e36dc81292eb2cc5b31e1b84c738b2: Status 404 returned error can't find the container with id b064d8ac66c61743cd3feb6f2c97bb79a4e36dc81292eb2cc5b31e1b84c738b2 Jul 14 01:08:31.774244 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.774214 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:31.831813 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.831782 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:31.944725 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:31.944688 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" event={"ID":"4141c1e0-a0c0-4574-989f-f577f6403603","Type":"ContainerStarted","Data":"b064d8ac66c61743cd3feb6f2c97bb79a4e36dc81292eb2cc5b31e1b84c738b2"} Jul 14 01:08:33.213210 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:33.213175 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:33.269229 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:33.269195 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:33.957425 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:33.957383 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" event={"ID":"0446cde6-acf6-4c19-a867-d9c723825ce1","Type":"ContainerStarted","Data":"cc08b86fa8c7b0758cedff9fa5c031fcaa075ca7496c09767214afd8eb391264"} Jul 14 01:08:33.957614 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:33.957501 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" Jul 14 01:08:33.976269 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:33.976219 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" podStartSLOduration=1.319315505 podStartE2EDuration="3.976204217s" totalImagesPullingTime="2.656888712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:33.973773814 +0000 UTC m=+561.844209006" watchObservedRunningTime="2026-07-14 01:08:33.976204217 +0000 UTC m=+561.846639407" Jul 14 01:08:34.694039 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:34.694000 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:39.934616 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:39.934584 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:41.047855 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.047784 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:41.148269 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.148229 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:41.721063 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.721027 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd"] Jul 14 01:08:41.721273 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.721246 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" containerName="manager" containerID="cri-o://08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc" gracePeriod=2 Jul 14 01:08:41.726632 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.726572 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd"] Jul 14 01:08:41.746883 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.746850 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm"] Jul 14 01:08:41.747493 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.747467 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" containerName="manager" Jul 14 01:08:41.747493 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.747495 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" containerName="manager" Jul 14 01:08:41.747679 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.747587 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" containerName="manager" Jul 14 01:08:41.750785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.750763 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:41.764829 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.764755 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm"] Jul 14 01:08:41.783152 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:08:41.783110 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" is forbidden: User \"system:node:ip-10-0-131-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-57.ec2.internal' and this object" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:41.901635 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.901597 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh2bm\" (UID: \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:41.902006 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.901698 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t5gv\" (UniqueName: \"kubernetes.io/projected/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-kube-api-access-8t5gv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh2bm\" (UID: \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:41.990881 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:41.990857 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:41.993835 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:08:41.993807 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" is forbidden: User \"system:node:ip-10-0-131-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-57.ec2.internal' and this object" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:42.002109 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.002083 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t5gv\" (UniqueName: \"kubernetes.io/projected/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-kube-api-access-8t5gv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh2bm\" (UID: \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:42.002216 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.002146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh2bm\" (UID: \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:42.002555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.002530 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh2bm\" (UID: \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:42.009811 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.009783 2570 generic.go:356] "Generic (PLEG): container finished" podID="e13b82f7-a488-40fc-b618-70eae1153deb" containerID="08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc" exitCode=0 Jul 14 01:08:42.009972 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.009838 2570 scope.go:117] "RemoveContainer" containerID="08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc" Jul 14 01:08:42.009972 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.009839 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:42.012208 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:08:42.012173 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" is forbidden: User \"system:node:ip-10-0-131-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-57.ec2.internal' and this object" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:42.013584 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.013560 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t5gv\" (UniqueName: \"kubernetes.io/projected/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-kube-api-access-8t5gv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mh2bm\" (UID: \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:42.028565 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.028539 2570 scope.go:117] "RemoveContainer" containerID="08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc" Jul 14 01:08:42.028881 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:08:42.028856 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc\": container with ID starting with 08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc not found: ID does not exist" containerID="08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc" Jul 14 01:08:42.028989 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.028889 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc"} err="failed to get container status \"08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc\": rpc error: code = NotFound desc = could not find container \"08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc\": container with ID starting with 08d51c89d8a1ca913fe6cf8ad909b974f4d622b817ffc90f1d7c529ab31488fc not found: ID does not exist" Jul 14 01:08:42.090590 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.090557 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:42.102900 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.102874 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj28z\" (UniqueName: \"kubernetes.io/projected/e13b82f7-a488-40fc-b618-70eae1153deb-kube-api-access-tj28z\") pod \"e13b82f7-a488-40fc-b618-70eae1153deb\" (UID: \"e13b82f7-a488-40fc-b618-70eae1153deb\") " Jul 14 01:08:42.103046 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.103001 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13b82f7-a488-40fc-b618-70eae1153deb-extensions-socket-volume\") pod \"e13b82f7-a488-40fc-b618-70eae1153deb\" (UID: \"e13b82f7-a488-40fc-b618-70eae1153deb\") " Jul 14 01:08:42.103443 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.103422 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e13b82f7-a488-40fc-b618-70eae1153deb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e13b82f7-a488-40fc-b618-70eae1153deb" (UID: "e13b82f7-a488-40fc-b618-70eae1153deb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:42.105859 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.105814 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e13b82f7-a488-40fc-b618-70eae1153deb-kube-api-access-tj28z" (OuterVolumeSpecName: "kube-api-access-tj28z") pod "e13b82f7-a488-40fc-b618-70eae1153deb" (UID: "e13b82f7-a488-40fc-b618-70eae1153deb"). InnerVolumeSpecName "kube-api-access-tj28z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:08:42.204888 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.204508 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e13b82f7-a488-40fc-b618-70eae1153deb-extensions-socket-volume\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:42.204888 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.204542 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj28z\" (UniqueName: \"kubernetes.io/projected/e13b82f7-a488-40fc-b618-70eae1153deb-kube-api-access-tj28z\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:42.268036 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.268014 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm"] Jul 14 01:08:42.270553 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:08:42.270520 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460239cf_c3ce_4a0a_a3e4_533d79fc7d6b.slice/crio-ec1febc31ff51c034eda053d88d0d078d4a2e2db9f6416773a6865fb1bb48aa8 WatchSource:0}: Error finding container ec1febc31ff51c034eda053d88d0d078d4a2e2db9f6416773a6865fb1bb48aa8: Status 404 returned error can't find the container with id ec1febc31ff51c034eda053d88d0d078d4a2e2db9f6416773a6865fb1bb48aa8 Jul 14 01:08:42.332542 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:08:42.332505 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" is forbidden: User \"system:node:ip-10-0-131-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-57.ec2.internal' and this object" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:42.665532 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:08:42.665499 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tkkhd\" is forbidden: User \"system:node:ip-10-0-131-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-57.ec2.internal' and this object" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkkhd" Jul 14 01:08:42.667136 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:42.667102 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e13b82f7-a488-40fc-b618-70eae1153deb" path="/var/lib/kubelet/pods/e13b82f7-a488-40fc-b618-70eae1153deb/volumes" Jul 14 01:08:43.017296 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:43.017208 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" event={"ID":"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b","Type":"ContainerStarted","Data":"f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539"} Jul 14 01:08:43.017296 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:43.017290 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" event={"ID":"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b","Type":"ContainerStarted","Data":"ec1febc31ff51c034eda053d88d0d078d4a2e2db9f6416773a6865fb1bb48aa8"} Jul 14 01:08:43.017488 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:43.017335 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:43.036141 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:43.036098 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" podStartSLOduration=2.036085418 podStartE2EDuration="2.036085418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:43.033865895 +0000 UTC m=+570.904301104" watchObservedRunningTime="2026-07-14 01:08:43.036085418 +0000 UTC m=+570.906520610" Jul 14 01:08:43.649406 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:43.649366 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:43.748132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:43.748098 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:44.966265 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:44.966228 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hrdxg" Jul 14 01:08:45.897515 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:45.897432 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:46.114052 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:46.113980 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:49.066044 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:49.065964 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:51.223353 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:51.223308 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:51.279117 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:51.279077 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:52.219208 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:52.219170 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:54.026195 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:54.026155 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:57.010788 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:57.010746 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:57.111805 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:57.111771 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:08:58.100132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:58.100100 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" event={"ID":"4141c1e0-a0c0-4574-989f-f577f6403603","Type":"ContainerStarted","Data":"cd6f99cd05694a379699b24abeb749d2181ed48a87d881a7b98226b5bd1e7dfb"} Jul 14 01:08:58.114713 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:58.114655 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pstxb" podStartSLOduration=1.8151983729999999 podStartE2EDuration="27.114637759s" totalImagesPullingTime="25.299439386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:08:58.113840109 +0000 UTC m=+585.984275299" watchObservedRunningTime="2026-07-14 01:08:58.114637759 +0000 UTC m=+585.985072951" Jul 14 01:08:59.297736 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.297704 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm"] Jul 14 01:08:59.298142 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.297966 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" podUID="460239cf-c3ce-4a0a-a3e4-533d79fc7d6b" containerName="manager" containerID="cri-o://f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539" gracePeriod=10 Jul 14 01:08:59.556772 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.556707 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:08:59.640901 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.640872 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-extensions-socket-volume\") pod \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\" (UID: \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\") " Jul 14 01:08:59.641107 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.640937 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t5gv\" (UniqueName: \"kubernetes.io/projected/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-kube-api-access-8t5gv\") pod \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\" (UID: \"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b\") " Jul 14 01:08:59.641334 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.641307 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "460239cf-c3ce-4a0a-a3e4-533d79fc7d6b" (UID: "460239cf-c3ce-4a0a-a3e4-533d79fc7d6b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:08:59.643143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.643119 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-kube-api-access-8t5gv" (OuterVolumeSpecName: "kube-api-access-8t5gv") pod "460239cf-c3ce-4a0a-a3e4-533d79fc7d6b" (UID: "460239cf-c3ce-4a0a-a3e4-533d79fc7d6b"). InnerVolumeSpecName "kube-api-access-8t5gv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:08:59.741830 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.741799 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-extensions-socket-volume\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:08:59.741830 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:08:59.741824 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t5gv\" (UniqueName: \"kubernetes.io/projected/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b-kube-api-access-8t5gv\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:09:00.111192 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.111152 2570 generic.go:356] "Generic (PLEG): container finished" podID="460239cf-c3ce-4a0a-a3e4-533d79fc7d6b" containerID="f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539" exitCode=0 Jul 14 01:09:00.111378 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.111199 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" Jul 14 01:09:00.111378 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.111242 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" event={"ID":"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b","Type":"ContainerDied","Data":"f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539"} Jul 14 01:09:00.111378 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.111303 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm" event={"ID":"460239cf-c3ce-4a0a-a3e4-533d79fc7d6b","Type":"ContainerDied","Data":"ec1febc31ff51c034eda053d88d0d078d4a2e2db9f6416773a6865fb1bb48aa8"} Jul 14 01:09:00.111378 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.111331 2570 scope.go:117] "RemoveContainer" containerID="f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539" Jul 14 01:09:00.120684 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.120662 2570 scope.go:117] "RemoveContainer" containerID="f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539" Jul 14 01:09:00.120954 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:09:00.120932 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539\": container with ID starting with f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539 not found: ID does not exist" containerID="f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539" Jul 14 01:09:00.121027 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.120961 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539"} err="failed to get container status \"f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539\": rpc error: code = NotFound desc = could not find container \"f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539\": container with ID starting with f5a8f2f1ced4ecd3e691e9e830b414e81cf50edb682b32967b069a4a11053539 not found: ID does not exist" Jul 14 01:09:00.135702 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.135673 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm"] Jul 14 01:09:00.140122 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.140096 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mh2bm"] Jul 14 01:09:00.665181 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:00.665148 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460239cf-c3ce-4a0a-a3e4-533d79fc7d6b" path="/var/lib/kubelet/pods/460239cf-c3ce-4a0a-a3e4-533d79fc7d6b/volumes" Jul 14 01:09:06.023747 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:06.023715 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:06.122116 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:06.122084 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:09.023985 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:09.023951 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:09.124721 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:09.124684 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:12.129897 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:12.129865 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:12.175679 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:12.175643 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:15.622450 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.622410 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf"] Jul 14 01:09:15.626760 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.622757 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460239cf-c3ce-4a0a-a3e4-533d79fc7d6b" containerName="manager" Jul 14 01:09:15.626760 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.622772 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="460239cf-c3ce-4a0a-a3e4-533d79fc7d6b" containerName="manager" Jul 14 01:09:15.626760 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.622847 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="460239cf-c3ce-4a0a-a3e4-533d79fc7d6b" containerName="manager" Jul 14 01:09:15.627211 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.627196 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.629866 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.629844 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 01:09:15.630040 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.630000 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tsnn7\"" Jul 14 01:09:15.636116 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.636092 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf"] Jul 14 01:09:15.656531 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.656505 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:15.676459 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.676459 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676460 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ce7b50-7732-4475-8577-d986d4612aee-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.676621 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676479 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.676621 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676496 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ce7b50-7732-4475-8577-d986d4612aee-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.676621 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ce7b50-7732-4475-8577-d986d4612aee-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.676621 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676599 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.676767 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676623 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7c2\" (UniqueName: \"kubernetes.io/projected/a7ce7b50-7732-4475-8577-d986d4612aee-kube-api-access-dr7c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.676767 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.676767 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.676721 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.777496 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777461 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.777496 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777501 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.777711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777545 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.777711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777561 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ce7b50-7732-4475-8577-d986d4612aee-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.777711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777599 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.777711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777625 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ce7b50-7732-4475-8577-d986d4612aee-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.777711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777663 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ce7b50-7732-4475-8577-d986d4612aee-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.777711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777702 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.778037 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7c2\" (UniqueName: \"kubernetes.io/projected/a7ce7b50-7732-4475-8577-d986d4612aee-kube-api-access-dr7c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.778037 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777943 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.778037 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.777979 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.778190 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.778080 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.778338 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.778316 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.778398 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.778332 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ce7b50-7732-4475-8577-d986d4612aee-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.780275 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.780258 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ce7b50-7732-4475-8577-d986d4612aee-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.780415 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.780398 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ce7b50-7732-4475-8577-d986d4612aee-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.788592 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.788568 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ce7b50-7732-4475-8577-d986d4612aee-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.788691 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.788567 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7c2\" (UniqueName: \"kubernetes.io/projected/a7ce7b50-7732-4475-8577-d986d4612aee-kube-api-access-dr7c2\") pod \"maas-default-gateway-openshift-default-56654dcf7-b67qf\" (UID: \"a7ce7b50-7732-4475-8577-d986d4612aee\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:15.917898 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.917869 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:15.938565 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:15.938529 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:16.100851 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:16.100826 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf"] Jul 14 01:09:16.103285 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:09:16.103262 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ce7b50_7732_4475_8577_d986d4612aee.slice/crio-8262e68259eb5960d311575dcfa07579ea3f6bec586ca1f4313c1eb31f90bc4e WatchSource:0}: Error finding container 8262e68259eb5960d311575dcfa07579ea3f6bec586ca1f4313c1eb31f90bc4e: Status 404 returned error can't find the container with id 8262e68259eb5960d311575dcfa07579ea3f6bec586ca1f4313c1eb31f90bc4e Jul 14 01:09:16.187605 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:16.187529 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" event={"ID":"a7ce7b50-7732-4475-8577-d986d4612aee","Type":"ContainerStarted","Data":"8262e68259eb5960d311575dcfa07579ea3f6bec586ca1f4313c1eb31f90bc4e"} Jul 14 01:09:17.450176 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:17.450132 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:17.556488 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:17.556440 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:20.180842 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:20.180797 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:09:20.181265 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:20.180889 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:09:20.181265 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:20.180961 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:09:21.216595 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:21.216553 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" event={"ID":"a7ce7b50-7732-4475-8577-d986d4612aee","Type":"ContainerStarted","Data":"99fd4bb3fd4f1428d6cb1b16dc68ec0c5ea747c35f8cf23b2641b09af7739263"} Jul 14 01:09:21.239112 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:21.239056 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" podStartSLOduration=2.163856918 podStartE2EDuration="6.23903846s" totalImagesPullingTime="4.075181542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:09:21.237733433 +0000 UTC m=+609.108168625" watchObservedRunningTime="2026-07-14 01:09:21.23903846 +0000 UTC m=+609.109473652" Jul 14 01:09:21.939384 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:21.939349 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:21.944032 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:21.944011 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:22.221439 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.221369 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:22.222308 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.222287 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:09:22.339481 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.339444 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:22.346425 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.346397 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q6sdx"] Jul 14 01:09:22.397382 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.397347 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q6sdx"] Jul 14 01:09:22.397533 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.397445 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:22.400293 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.400272 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 01:09:22.443117 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.443089 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q6sdx"] Jul 14 01:09:22.448381 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.448337 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:22.506977 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.506868 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:22.540328 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.540294 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13744416-ceef-4267-abf4-962f3bbdef3c-config-file\") pod \"limitador-limitador-64c94fd64f-q6sdx\" (UID: \"13744416-ceef-4267-abf4-962f3bbdef3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:22.540497 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.540357 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxpj\" (UniqueName: \"kubernetes.io/projected/13744416-ceef-4267-abf4-962f3bbdef3c-kube-api-access-lpxpj\") pod \"limitador-limitador-64c94fd64f-q6sdx\" (UID: \"13744416-ceef-4267-abf4-962f3bbdef3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:22.641641 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.641603 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13744416-ceef-4267-abf4-962f3bbdef3c-config-file\") pod \"limitador-limitador-64c94fd64f-q6sdx\" (UID: \"13744416-ceef-4267-abf4-962f3bbdef3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:22.641819 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.641673 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxpj\" (UniqueName: \"kubernetes.io/projected/13744416-ceef-4267-abf4-962f3bbdef3c-kube-api-access-lpxpj\") pod \"limitador-limitador-64c94fd64f-q6sdx\" (UID: \"13744416-ceef-4267-abf4-962f3bbdef3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:22.642243 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.642223 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13744416-ceef-4267-abf4-962f3bbdef3c-config-file\") pod \"limitador-limitador-64c94fd64f-q6sdx\" (UID: \"13744416-ceef-4267-abf4-962f3bbdef3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:22.649592 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.649571 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxpj\" (UniqueName: \"kubernetes.io/projected/13744416-ceef-4267-abf4-962f3bbdef3c-kube-api-access-lpxpj\") pod \"limitador-limitador-64c94fd64f-q6sdx\" (UID: \"13744416-ceef-4267-abf4-962f3bbdef3c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:22.708023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:22.707987 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:23.077597 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.077576 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q6sdx"] Jul 14 01:09:23.079683 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:09:23.079658 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13744416_ceef_4267_abf4_962f3bbdef3c.slice/crio-963f85184d2c3d04ae76ca4a3d4e5fb7d61ff3b5d7409a009d37ed083cbca8e3 WatchSource:0}: Error finding container 963f85184d2c3d04ae76ca4a3d4e5fb7d61ff3b5d7409a009d37ed083cbca8e3: Status 404 returned error can't find the container with id 963f85184d2c3d04ae76ca4a3d4e5fb7d61ff3b5d7409a009d37ed083cbca8e3 Jul 14 01:09:23.082802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.082785 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 01:09:23.134190 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.134157 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jcqmw"] Jul 14 01:09:23.169180 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.169148 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:23.272908 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.272814 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:23.330897 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.330849 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" event={"ID":"13744416-ceef-4267-abf4-962f3bbdef3c","Type":"ContainerStarted","Data":"963f85184d2c3d04ae76ca4a3d4e5fb7d61ff3b5d7409a009d37ed083cbca8e3"} Jul 14 01:09:23.331078 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.330908 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jcqmw"] Jul 14 01:09:23.331078 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.331000 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jcqmw" Jul 14 01:09:23.331172 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.331002 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9mpw7"] Jul 14 01:09:23.333564 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.333542 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dncbs\"" Jul 14 01:09:23.431323 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.431288 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9mpw7"] Jul 14 01:09:23.431481 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.431411 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9mpw7" Jul 14 01:09:23.449814 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.449789 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv4nc\" (UniqueName: \"kubernetes.io/projected/e67f9f10-d34c-439b-9e9d-9dd14711d844-kube-api-access-hv4nc\") pod \"authorino-58cd955675-jcqmw\" (UID: \"e67f9f10-d34c-439b-9e9d-9dd14711d844\") " pod="kuadrant-system/authorino-58cd955675-jcqmw" Jul 14 01:09:23.550559 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.550478 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vs6d\" (UniqueName: \"kubernetes.io/projected/e3d42448-4df6-42d7-899c-602ade8984db-kube-api-access-6vs6d\") pod \"authorino-75d556bd77-9mpw7\" (UID: \"e3d42448-4df6-42d7-899c-602ade8984db\") " pod="kuadrant-system/authorino-75d556bd77-9mpw7" Jul 14 01:09:23.550559 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.550521 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv4nc\" (UniqueName: \"kubernetes.io/projected/e67f9f10-d34c-439b-9e9d-9dd14711d844-kube-api-access-hv4nc\") pod \"authorino-58cd955675-jcqmw\" (UID: \"e67f9f10-d34c-439b-9e9d-9dd14711d844\") " pod="kuadrant-system/authorino-58cd955675-jcqmw" Jul 14 01:09:23.564076 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.564038 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv4nc\" (UniqueName: \"kubernetes.io/projected/e67f9f10-d34c-439b-9e9d-9dd14711d844-kube-api-access-hv4nc\") pod \"authorino-58cd955675-jcqmw\" (UID: \"e67f9f10-d34c-439b-9e9d-9dd14711d844\") " pod="kuadrant-system/authorino-58cd955675-jcqmw" Jul 14 01:09:23.640184 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.640158 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jcqmw" Jul 14 01:09:23.651574 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.651549 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vs6d\" (UniqueName: \"kubernetes.io/projected/e3d42448-4df6-42d7-899c-602ade8984db-kube-api-access-6vs6d\") pod \"authorino-75d556bd77-9mpw7\" (UID: \"e3d42448-4df6-42d7-899c-602ade8984db\") " pod="kuadrant-system/authorino-75d556bd77-9mpw7" Jul 14 01:09:23.669801 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.669775 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vs6d\" (UniqueName: \"kubernetes.io/projected/e3d42448-4df6-42d7-899c-602ade8984db-kube-api-access-6vs6d\") pod \"authorino-75d556bd77-9mpw7\" (UID: \"e3d42448-4df6-42d7-899c-602ade8984db\") " pod="kuadrant-system/authorino-75d556bd77-9mpw7" Jul 14 01:09:23.740613 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.740582 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9mpw7" Jul 14 01:09:23.800190 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.800126 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jcqmw"] Jul 14 01:09:23.804085 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:09:23.804035 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode67f9f10_d34c_439b_9e9d_9dd14711d844.slice/crio-baab70a2861e6b72e3453e652300a0fe65e30a6d13e1e116627f9c60f1d45887 WatchSource:0}: Error finding container baab70a2861e6b72e3453e652300a0fe65e30a6d13e1e116627f9c60f1d45887: Status 404 returned error can't find the container with id baab70a2861e6b72e3453e652300a0fe65e30a6d13e1e116627f9c60f1d45887 Jul 14 01:09:23.886906 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:23.886865 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9mpw7"] Jul 14 01:09:23.889193 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:09:23.889163 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3d42448_4df6_42d7_899c_602ade8984db.slice/crio-a74ef0a9f97887e89d34414681dc30e5fe5383e16325230207fa18ce5fcfc6e5 WatchSource:0}: Error finding container a74ef0a9f97887e89d34414681dc30e5fe5383e16325230207fa18ce5fcfc6e5: Status 404 returned error can't find the container with id a74ef0a9f97887e89d34414681dc30e5fe5383e16325230207fa18ce5fcfc6e5 Jul 14 01:09:24.242218 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:24.242171 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jcqmw" event={"ID":"e67f9f10-d34c-439b-9e9d-9dd14711d844","Type":"ContainerStarted","Data":"baab70a2861e6b72e3453e652300a0fe65e30a6d13e1e116627f9c60f1d45887"} Jul 14 01:09:24.243944 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:24.243894 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9mpw7" event={"ID":"e3d42448-4df6-42d7-899c-602ade8984db","Type":"ContainerStarted","Data":"a74ef0a9f97887e89d34414681dc30e5fe5383e16325230207fa18ce5fcfc6e5"} Jul 14 01:09:26.439113 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:26.439071 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:26.669365 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:26.669327 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:28.270689 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:28.270647 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" event={"ID":"13744416-ceef-4267-abf4-962f3bbdef3c","Type":"ContainerStarted","Data":"6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c"} Jul 14 01:09:28.271076 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:28.270747 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:28.289404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:28.289362 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" podStartSLOduration=1.233794604 podStartE2EDuration="6.289345717s" totalImagesPullingTime="5.055551113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:09:28.287905123 +0000 UTC m=+616.158340322" watchObservedRunningTime="2026-07-14 01:09:28.289345717 +0000 UTC m=+616.159780936" Jul 14 01:09:29.276559 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:29.276523 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jcqmw" event={"ID":"e67f9f10-d34c-439b-9e9d-9dd14711d844","Type":"ContainerStarted","Data":"4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3"} Jul 14 01:09:29.278072 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:29.278045 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9mpw7" event={"ID":"e3d42448-4df6-42d7-899c-602ade8984db","Type":"ContainerStarted","Data":"d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4"} Jul 14 01:09:29.290477 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:29.290422 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jcqmw" podStartSLOduration=1.8915766349999998 podStartE2EDuration="6.290396964s" totalImagesPullingTime="4.398820329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:09:29.290264726 +0000 UTC m=+617.160699919" watchObservedRunningTime="2026-07-14 01:09:29.290396964 +0000 UTC m=+617.160832160" Jul 14 01:09:29.308210 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:29.308148 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9mpw7" podStartSLOduration=1.9818141950000001 podStartE2EDuration="6.308124899s" totalImagesPullingTime="4.326310704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:09:29.306459327 +0000 UTC m=+617.176894519" watchObservedRunningTime="2026-07-14 01:09:29.308124899 +0000 UTC m=+617.178560095" Jul 14 01:09:29.332683 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:29.332651 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jcqmw"] Jul 14 01:09:29.436837 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:29.436798 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:29.538697 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:29.538605 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:31.292473 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:31.292415 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jcqmw" podUID="e67f9f10-d34c-439b-9e9d-9dd14711d844" containerName="authorino" containerID="cri-o://4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3" gracePeriod=30 Jul 14 01:09:31.545792 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:31.545732 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jcqmw" Jul 14 01:09:31.628492 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:31.628462 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv4nc\" (UniqueName: \"kubernetes.io/projected/e67f9f10-d34c-439b-9e9d-9dd14711d844-kube-api-access-hv4nc\") pod \"e67f9f10-d34c-439b-9e9d-9dd14711d844\" (UID: \"e67f9f10-d34c-439b-9e9d-9dd14711d844\") " Jul 14 01:09:31.630726 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:31.630687 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67f9f10-d34c-439b-9e9d-9dd14711d844-kube-api-access-hv4nc" (OuterVolumeSpecName: "kube-api-access-hv4nc") pod "e67f9f10-d34c-439b-9e9d-9dd14711d844" (UID: "e67f9f10-d34c-439b-9e9d-9dd14711d844"). InnerVolumeSpecName "kube-api-access-hv4nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:09:31.729248 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:31.729212 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv4nc\" (UniqueName: \"kubernetes.io/projected/e67f9f10-d34c-439b-9e9d-9dd14711d844-kube-api-access-hv4nc\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:09:32.298064 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.298028 2570 generic.go:356] "Generic (PLEG): container finished" podID="e67f9f10-d34c-439b-9e9d-9dd14711d844" containerID="4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3" exitCode=0 Jul 14 01:09:32.298499 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.298070 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jcqmw" Jul 14 01:09:32.298499 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.298081 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jcqmw" event={"ID":"e67f9f10-d34c-439b-9e9d-9dd14711d844","Type":"ContainerDied","Data":"4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3"} Jul 14 01:09:32.298499 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.298107 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jcqmw" event={"ID":"e67f9f10-d34c-439b-9e9d-9dd14711d844","Type":"ContainerDied","Data":"baab70a2861e6b72e3453e652300a0fe65e30a6d13e1e116627f9c60f1d45887"} Jul 14 01:09:32.298499 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.298125 2570 scope.go:117] "RemoveContainer" containerID="4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3" Jul 14 01:09:32.308018 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.307903 2570 scope.go:117] "RemoveContainer" containerID="4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3" Jul 14 01:09:32.308342 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:09:32.308276 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3\": container with ID starting with 4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3 not found: ID does not exist" containerID="4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3" Jul 14 01:09:32.308342 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.308312 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3"} err="failed to get container status \"4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3\": rpc error: code = NotFound desc = could not find container \"4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3\": container with ID starting with 4f4d6805430c67aa42377f5355f7401251fc5f8971185e91e622620a503b1ee3 not found: ID does not exist" Jul 14 01:09:32.318201 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.318176 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jcqmw"] Jul 14 01:09:32.323891 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.323872 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jcqmw"] Jul 14 01:09:32.666666 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:32.666638 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67f9f10-d34c-439b-9e9d-9dd14711d844" path="/var/lib/kubelet/pods/e67f9f10-d34c-439b-9e9d-9dd14711d844/volumes" Jul 14 01:09:33.163595 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:33.163507 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:33.215611 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:33.215575 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:38.216200 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.216117 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q6sdx"] Jul 14 01:09:38.216628 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.216334 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" podUID="13744416-ceef-4267-abf4-962f3bbdef3c" containerName="limitador" containerID="cri-o://6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c" gracePeriod=30 Jul 14 01:09:38.218442 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.218410 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:38.767543 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.767520 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:38.886709 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.886621 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13744416-ceef-4267-abf4-962f3bbdef3c-config-file\") pod \"13744416-ceef-4267-abf4-962f3bbdef3c\" (UID: \"13744416-ceef-4267-abf4-962f3bbdef3c\") " Jul 14 01:09:38.886709 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.886653 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpxpj\" (UniqueName: \"kubernetes.io/projected/13744416-ceef-4267-abf4-962f3bbdef3c-kube-api-access-lpxpj\") pod \"13744416-ceef-4267-abf4-962f3bbdef3c\" (UID: \"13744416-ceef-4267-abf4-962f3bbdef3c\") " Jul 14 01:09:38.887031 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.886968 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13744416-ceef-4267-abf4-962f3bbdef3c-config-file" (OuterVolumeSpecName: "config-file") pod "13744416-ceef-4267-abf4-962f3bbdef3c" (UID: "13744416-ceef-4267-abf4-962f3bbdef3c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:09:38.888851 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.888828 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13744416-ceef-4267-abf4-962f3bbdef3c-kube-api-access-lpxpj" (OuterVolumeSpecName: "kube-api-access-lpxpj") pod "13744416-ceef-4267-abf4-962f3bbdef3c" (UID: "13744416-ceef-4267-abf4-962f3bbdef3c"). InnerVolumeSpecName "kube-api-access-lpxpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:09:38.988107 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.988074 2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13744416-ceef-4267-abf4-962f3bbdef3c-config-file\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:09:38.988107 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:38.988103 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpxpj\" (UniqueName: \"kubernetes.io/projected/13744416-ceef-4267-abf4-962f3bbdef3c-kube-api-access-lpxpj\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:09:39.332179 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.332141 2570 generic.go:356] "Generic (PLEG): container finished" podID="13744416-ceef-4267-abf4-962f3bbdef3c" containerID="6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c" exitCode=0 Jul 14 01:09:39.332566 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.332191 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" Jul 14 01:09:39.332566 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.332222 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" event={"ID":"13744416-ceef-4267-abf4-962f3bbdef3c","Type":"ContainerDied","Data":"6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c"} Jul 14 01:09:39.332566 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.332271 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-q6sdx" event={"ID":"13744416-ceef-4267-abf4-962f3bbdef3c","Type":"ContainerDied","Data":"963f85184d2c3d04ae76ca4a3d4e5fb7d61ff3b5d7409a009d37ed083cbca8e3"} Jul 14 01:09:39.332566 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.332292 2570 scope.go:117] "RemoveContainer" containerID="6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c" Jul 14 01:09:39.340842 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.340828 2570 scope.go:117] "RemoveContainer" containerID="6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c" Jul 14 01:09:39.341102 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:09:39.341085 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c\": container with ID starting with 6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c not found: ID does not exist" containerID="6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c" Jul 14 01:09:39.341153 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.341110 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c"} err="failed to get container status \"6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c\": rpc error: code = NotFound desc = could not find container \"6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c\": container with ID starting with 6015089f130be0fafbe2c22df741c6484f5e0b6092cf47ad1ff98c1cce6dc88c not found: ID does not exist" Jul 14 01:09:39.352297 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.352275 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q6sdx"] Jul 14 01:09:39.354420 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:39.354396 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-q6sdx"] Jul 14 01:09:40.664634 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:40.664603 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13744416-ceef-4267-abf4-962f3bbdef3c" path="/var/lib/kubelet/pods/13744416-ceef-4267-abf4-962f3bbdef3c/volumes" Jul 14 01:09:43.629503 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:43.629466 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:43.733084 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:43.733051 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:44.145738 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.145707 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm"] Jul 14 01:09:44.146073 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.146061 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67f9f10-d34c-439b-9e9d-9dd14711d844" containerName="authorino" Jul 14 01:09:44.146123 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.146074 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67f9f10-d34c-439b-9e9d-9dd14711d844" containerName="authorino" Jul 14 01:09:44.146123 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.146112 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13744416-ceef-4267-abf4-962f3bbdef3c" containerName="limitador" Jul 14 01:09:44.146123 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.146121 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="13744416-ceef-4267-abf4-962f3bbdef3c" containerName="limitador" Jul 14 01:09:44.146228 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.146199 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67f9f10-d34c-439b-9e9d-9dd14711d844" containerName="authorino" Jul 14 01:09:44.146228 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.146208 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="13744416-ceef-4267-abf4-962f3bbdef3c" containerName="limitador" Jul 14 01:09:44.150273 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.150255 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:44.152732 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.152691 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 01:09:44.152861 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.152782 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 01:09:44.152861 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.152851 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-fbk9b\"" Jul 14 01:09:44.152972 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.152850 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 01:09:44.159889 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.159867 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm"] Jul 14 01:09:44.176992 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.176962 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:44.330898 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.330858 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf-data\") pod \"postgres-69fb4594cf-wrpxm\" (UID: \"02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:44.331104 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.330966 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrnkx\" (UniqueName: \"kubernetes.io/projected/02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf-kube-api-access-rrnkx\") pod \"postgres-69fb4594cf-wrpxm\" (UID: \"02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:44.431503 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.431469 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrnkx\" (UniqueName: \"kubernetes.io/projected/02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf-kube-api-access-rrnkx\") pod \"postgres-69fb4594cf-wrpxm\" (UID: \"02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:44.431690 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.431538 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf-data\") pod \"postgres-69fb4594cf-wrpxm\" (UID: \"02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:44.431839 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.431821 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf-data\") pod \"postgres-69fb4594cf-wrpxm\" (UID: \"02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:44.439438 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.439412 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrnkx\" (UniqueName: \"kubernetes.io/projected/02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf-kube-api-access-rrnkx\") pod \"postgres-69fb4594cf-wrpxm\" (UID: \"02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:44.461270 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.461233 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:44.591529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:44.591502 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm"] Jul 14 01:09:44.593294 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:09:44.593267 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f9fc3b_ca0c_4d7f_bc20_07fb15ed29bf.slice/crio-659e700cbe5de5179753c635afbd4586815ee1652762488c8fbe26dbcf1a0612 WatchSource:0}: Error finding container 659e700cbe5de5179753c635afbd4586815ee1652762488c8fbe26dbcf1a0612: Status 404 returned error can't find the container with id 659e700cbe5de5179753c635afbd4586815ee1652762488c8fbe26dbcf1a0612 Jul 14 01:09:45.364382 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:45.364346 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" event={"ID":"02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf","Type":"ContainerStarted","Data":"659e700cbe5de5179753c635afbd4586815ee1652762488c8fbe26dbcf1a0612"} Jul 14 01:09:50.393849 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:50.393756 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" event={"ID":"02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf","Type":"ContainerStarted","Data":"ce8a03b2deb90df89ee0e0f87bbe17492355009ef9706a684c815833cca3c807"} Jul 14 01:09:50.394247 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:50.393901 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:50.409473 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:50.409423 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" podStartSLOduration=0.960739577 podStartE2EDuration="6.409406479s" totalImagesPullingTime="5.448666902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:09:50.408551616 +0000 UTC m=+638.278986807" watchObservedRunningTime="2026-07-14 01:09:50.409406479 +0000 UTC m=+638.279841666" Jul 14 01:09:56.429519 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:56.429489 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-wrpxm" Jul 14 01:09:56.748425 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:56.748345 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:56.848221 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:56.848175 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:09:56.996584 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:56.996552 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tqgzz"] Jul 14 01:09:57.000136 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.000091 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" Jul 14 01:09:57.006536 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.006512 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tqgzz"] Jul 14 01:09:57.028880 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.028848 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hzd\" (UniqueName: \"kubernetes.io/projected/401216b2-5544-4cbc-8e54-98b8670c05f5-kube-api-access-n2hzd\") pod \"authorino-5d4b67c446-tqgzz\" (UID: \"401216b2-5544-4cbc-8e54-98b8670c05f5\") " pod="kuadrant-system/authorino-5d4b67c446-tqgzz" Jul 14 01:09:57.130198 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.130170 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hzd\" (UniqueName: \"kubernetes.io/projected/401216b2-5544-4cbc-8e54-98b8670c05f5-kube-api-access-n2hzd\") pod \"authorino-5d4b67c446-tqgzz\" (UID: \"401216b2-5544-4cbc-8e54-98b8670c05f5\") " pod="kuadrant-system/authorino-5d4b67c446-tqgzz" Jul 14 01:09:57.137539 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.137510 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hzd\" (UniqueName: \"kubernetes.io/projected/401216b2-5544-4cbc-8e54-98b8670c05f5-kube-api-access-n2hzd\") pod \"authorino-5d4b67c446-tqgzz\" (UID: \"401216b2-5544-4cbc-8e54-98b8670c05f5\") " pod="kuadrant-system/authorino-5d4b67c446-tqgzz" Jul 14 01:09:57.248171 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.248136 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tqgzz"] Jul 14 01:09:57.248400 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.248387 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" Jul 14 01:09:57.270020 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.269980 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c964b4657-68ssd"] Jul 14 01:09:57.274393 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.274370 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c964b4657-68ssd" Jul 14 01:09:57.277312 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.277285 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c964b4657-68ssd"] Jul 14 01:09:57.331640 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.331611 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gsn6\" (UniqueName: \"kubernetes.io/projected/762207ee-390b-4580-b868-33f587f393b0-kube-api-access-9gsn6\") pod \"authorino-5c964b4657-68ssd\" (UID: \"762207ee-390b-4580-b868-33f587f393b0\") " pod="kuadrant-system/authorino-5c964b4657-68ssd" Jul 14 01:09:57.350906 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.350878 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c964b4657-68ssd"] Jul 14 01:09:57.351191 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:09:57.351166 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9gsn6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5c964b4657-68ssd" podUID="762207ee-390b-4580-b868-33f587f393b0" Jul 14 01:09:57.380669 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.380644 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tqgzz"] Jul 14 01:09:57.382423 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:09:57.382390 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod401216b2_5544_4cbc_8e54_98b8670c05f5.slice/crio-3f455974a3b546e0413c49e510ec070bad08fa27d56d665a44981de992132237 WatchSource:0}: Error finding container 3f455974a3b546e0413c49e510ec070bad08fa27d56d665a44981de992132237: Status 404 returned error can't find the container with id 3f455974a3b546e0413c49e510ec070bad08fa27d56d665a44981de992132237 Jul 14 01:09:57.429755 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.429718 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" event={"ID":"401216b2-5544-4cbc-8e54-98b8670c05f5","Type":"ContainerStarted","Data":"3f455974a3b546e0413c49e510ec070bad08fa27d56d665a44981de992132237"} Jul 14 01:09:57.429755 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.429730 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c964b4657-68ssd" Jul 14 01:09:57.432101 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.432081 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gsn6\" (UniqueName: \"kubernetes.io/projected/762207ee-390b-4580-b868-33f587f393b0-kube-api-access-9gsn6\") pod \"authorino-5c964b4657-68ssd\" (UID: \"762207ee-390b-4580-b868-33f587f393b0\") " pod="kuadrant-system/authorino-5c964b4657-68ssd" Jul 14 01:09:57.436859 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.436841 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c964b4657-68ssd" Jul 14 01:09:57.446288 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.446259 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gsn6\" (UniqueName: \"kubernetes.io/projected/762207ee-390b-4580-b868-33f587f393b0-kube-api-access-9gsn6\") pod \"authorino-5c964b4657-68ssd\" (UID: \"762207ee-390b-4580-b868-33f587f393b0\") " pod="kuadrant-system/authorino-5c964b4657-68ssd" Jul 14 01:09:57.532941 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.532837 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gsn6\" (UniqueName: \"kubernetes.io/projected/762207ee-390b-4580-b868-33f587f393b0-kube-api-access-9gsn6\") pod \"762207ee-390b-4580-b868-33f587f393b0\" (UID: \"762207ee-390b-4580-b868-33f587f393b0\") " Jul 14 01:09:57.535065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.535043 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/762207ee-390b-4580-b868-33f587f393b0-kube-api-access-9gsn6" (OuterVolumeSpecName: "kube-api-access-9gsn6") pod "762207ee-390b-4580-b868-33f587f393b0" (UID: "762207ee-390b-4580-b868-33f587f393b0"). InnerVolumeSpecName "kube-api-access-9gsn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:09:57.633698 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:57.633663 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gsn6\" (UniqueName: \"kubernetes.io/projected/762207ee-390b-4580-b868-33f587f393b0-kube-api-access-9gsn6\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:09:58.434194 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:58.434158 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c964b4657-68ssd" Jul 14 01:09:58.463093 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:58.463059 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c964b4657-68ssd"] Jul 14 01:09:58.464788 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:58.464766 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c964b4657-68ssd"] Jul 14 01:09:58.664534 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:58.664499 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="762207ee-390b-4580-b868-33f587f393b0" path="/var/lib/kubelet/pods/762207ee-390b-4580-b868-33f587f393b0/volumes" Jul 14 01:09:59.441025 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:59.440990 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" event={"ID":"401216b2-5544-4cbc-8e54-98b8670c05f5","Type":"ContainerStarted","Data":"4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c"} Jul 14 01:09:59.441444 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:59.441068 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" podUID="401216b2-5544-4cbc-8e54-98b8670c05f5" containerName="authorino" containerID="cri-o://4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c" gracePeriod=30 Jul 14 01:09:59.455938 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:59.455874 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" podStartSLOduration=1.981274985 podStartE2EDuration="3.455858465s" totalImagesPullingTime="1.47458348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:09:59.454768298 +0000 UTC m=+647.325203489" watchObservedRunningTime="2026-07-14 01:09:59.455858465 +0000 UTC m=+647.326293672" Jul 14 01:09:59.730172 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:59.730149 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" Jul 14 01:09:59.753634 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:59.753600 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2hzd\" (UniqueName: \"kubernetes.io/projected/401216b2-5544-4cbc-8e54-98b8670c05f5-kube-api-access-n2hzd\") pod \"401216b2-5544-4cbc-8e54-98b8670c05f5\" (UID: \"401216b2-5544-4cbc-8e54-98b8670c05f5\") " Jul 14 01:09:59.755792 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:59.755762 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/401216b2-5544-4cbc-8e54-98b8670c05f5-kube-api-access-n2hzd" (OuterVolumeSpecName: "kube-api-access-n2hzd") pod "401216b2-5544-4cbc-8e54-98b8670c05f5" (UID: "401216b2-5544-4cbc-8e54-98b8670c05f5"). InnerVolumeSpecName "kube-api-access-n2hzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:09:59.854295 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:09:59.854262 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2hzd\" (UniqueName: \"kubernetes.io/projected/401216b2-5544-4cbc-8e54-98b8670c05f5-kube-api-access-n2hzd\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:10:00.446905 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.446866 2570 generic.go:356] "Generic (PLEG): container finished" podID="401216b2-5544-4cbc-8e54-98b8670c05f5" containerID="4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c" exitCode=0 Jul 14 01:10:00.447384 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.446931 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" Jul 14 01:10:00.447384 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.446951 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" event={"ID":"401216b2-5544-4cbc-8e54-98b8670c05f5","Type":"ContainerDied","Data":"4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c"} Jul 14 01:10:00.447384 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.447002 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-tqgzz" event={"ID":"401216b2-5544-4cbc-8e54-98b8670c05f5","Type":"ContainerDied","Data":"3f455974a3b546e0413c49e510ec070bad08fa27d56d665a44981de992132237"} Jul 14 01:10:00.447384 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.447027 2570 scope.go:117] "RemoveContainer" containerID="4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c" Jul 14 01:10:00.456388 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.456366 2570 scope.go:117] "RemoveContainer" containerID="4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c" Jul 14 01:10:00.456654 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:10:00.456635 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c\": container with ID starting with 4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c not found: ID does not exist" containerID="4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c" Jul 14 01:10:00.456713 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.456663 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c"} err="failed to get container status \"4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c\": rpc error: code = NotFound desc = could not find container \"4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c\": container with ID starting with 4582bb78fc1940e103b81f5cf55098aceb57dafea39f4446b42a239e5f55689c not found: ID does not exist" Jul 14 01:10:00.467075 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.467043 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tqgzz"] Jul 14 01:10:00.470391 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.470372 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tqgzz"] Jul 14 01:10:00.664485 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:00.664450 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="401216b2-5544-4cbc-8e54-98b8670c05f5" path="/var/lib/kubelet/pods/401216b2-5544-4cbc-8e54-98b8670c05f5/volumes" Jul 14 01:10:02.639745 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:02.639711 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9mpw7"] Jul 14 01:10:02.640212 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:02.639880 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9mpw7" podUID="e3d42448-4df6-42d7-899c-602ade8984db" containerName="authorino" containerID="cri-o://d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4" gracePeriod=30 Jul 14 01:10:02.893872 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:02.893807 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9mpw7" Jul 14 01:10:02.981802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:02.981763 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vs6d\" (UniqueName: \"kubernetes.io/projected/e3d42448-4df6-42d7-899c-602ade8984db-kube-api-access-6vs6d\") pod \"e3d42448-4df6-42d7-899c-602ade8984db\" (UID: \"e3d42448-4df6-42d7-899c-602ade8984db\") " Jul 14 01:10:02.983949 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:02.983906 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d42448-4df6-42d7-899c-602ade8984db-kube-api-access-6vs6d" (OuterVolumeSpecName: "kube-api-access-6vs6d") pod "e3d42448-4df6-42d7-899c-602ade8984db" (UID: "e3d42448-4df6-42d7-899c-602ade8984db"). InnerVolumeSpecName "kube-api-access-6vs6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:10:03.082727 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.082678 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vs6d\" (UniqueName: \"kubernetes.io/projected/e3d42448-4df6-42d7-899c-602ade8984db-kube-api-access-6vs6d\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:10:03.463759 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.463725 2570 generic.go:356] "Generic (PLEG): container finished" podID="e3d42448-4df6-42d7-899c-602ade8984db" containerID="d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4" exitCode=0 Jul 14 01:10:03.463957 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.463765 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9mpw7" Jul 14 01:10:03.463957 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.463789 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9mpw7" event={"ID":"e3d42448-4df6-42d7-899c-602ade8984db","Type":"ContainerDied","Data":"d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4"} Jul 14 01:10:03.463957 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.463819 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9mpw7" event={"ID":"e3d42448-4df6-42d7-899c-602ade8984db","Type":"ContainerDied","Data":"a74ef0a9f97887e89d34414681dc30e5fe5383e16325230207fa18ce5fcfc6e5"} Jul 14 01:10:03.463957 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.463835 2570 scope.go:117] "RemoveContainer" containerID="d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4" Jul 14 01:10:03.472621 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.472599 2570 scope.go:117] "RemoveContainer" containerID="d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4" Jul 14 01:10:03.472891 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:10:03.472873 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4\": container with ID starting with d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4 not found: ID does not exist" containerID="d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4" Jul 14 01:10:03.472981 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.472899 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4"} err="failed to get container status \"d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4\": rpc error: code = NotFound desc = could not find container \"d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4\": container with ID starting with d2df81977347fb1aaf7d2d85ffa048732b8e529d74bbc42feaf9246fe22f3eb4 not found: ID does not exist" Jul 14 01:10:03.485568 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.485543 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9mpw7"] Jul 14 01:10:03.488993 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:03.488971 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9mpw7"] Jul 14 01:10:04.664516 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:04.664483 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d42448-4df6-42d7-899c-602ade8984db" path="/var/lib/kubelet/pods/e3d42448-4df6-42d7-899c-602ade8984db/volumes" Jul 14 01:10:07.553647 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.553612 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bfb8c7b74-rt727"] Jul 14 01:10:07.554023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.553968 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d42448-4df6-42d7-899c-602ade8984db" containerName="authorino" Jul 14 01:10:07.554023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.553979 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d42448-4df6-42d7-899c-602ade8984db" containerName="authorino" Jul 14 01:10:07.554023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.553994 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401216b2-5544-4cbc-8e54-98b8670c05f5" containerName="authorino" Jul 14 01:10:07.554023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.553999 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="401216b2-5544-4cbc-8e54-98b8670c05f5" containerName="authorino" Jul 14 01:10:07.554152 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.554061 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d42448-4df6-42d7-899c-602ade8984db" containerName="authorino" Jul 14 01:10:07.554152 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.554070 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="401216b2-5544-4cbc-8e54-98b8670c05f5" containerName="authorino" Jul 14 01:10:07.556942 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.556926 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:07.559741 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.559719 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6qb7q\"" Jul 14 01:10:07.559870 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.559721 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 01:10:07.559870 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.559720 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 01:10:07.566483 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.566458 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bfb8c7b74-rt727"] Jul 14 01:10:07.622241 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.622207 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert\") pod \"maas-controller-5bfb8c7b74-rt727\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:07.622412 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.622255 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jpt7\" (UniqueName: \"kubernetes.io/projected/f2f2e9ee-1dee-4080-bdaf-c3817065155c-kube-api-access-6jpt7\") pod \"maas-controller-5bfb8c7b74-rt727\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:07.723134 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.723096 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jpt7\" (UniqueName: \"kubernetes.io/projected/f2f2e9ee-1dee-4080-bdaf-c3817065155c-kube-api-access-6jpt7\") pod \"maas-controller-5bfb8c7b74-rt727\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:07.723304 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.723181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert\") pod \"maas-controller-5bfb8c7b74-rt727\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:07.723304 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:10:07.723270 2570 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 14 01:10:07.723371 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:10:07.723344 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert podName:f2f2e9ee-1dee-4080-bdaf-c3817065155c nodeName:}" failed. No retries permitted until 2026-07-14 01:10:08.223328498 +0000 UTC m=+656.093763666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert") pod "maas-controller-5bfb8c7b74-rt727" (UID: "f2f2e9ee-1dee-4080-bdaf-c3817065155c") : secret "maas-controller-webhook-cert" not found Jul 14 01:10:07.738295 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.738268 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jpt7\" (UniqueName: \"kubernetes.io/projected/f2f2e9ee-1dee-4080-bdaf-c3817065155c-kube-api-access-6jpt7\") pod \"maas-controller-5bfb8c7b74-rt727\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:07.786273 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.786242 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7864cdfb78-ptvts"] Jul 14 01:10:07.789474 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.789459 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:07.799239 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.799216 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7864cdfb78-ptvts"] Jul 14 01:10:07.824404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.824322 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-webhook-cert\") pod \"maas-controller-7864cdfb78-ptvts\" (UID: \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\") " pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:07.824404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.824353 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2wzn\" (UniqueName: \"kubernetes.io/projected/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-kube-api-access-v2wzn\") pod \"maas-controller-7864cdfb78-ptvts\" (UID: \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\") " pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:07.925068 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.925031 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2wzn\" (UniqueName: \"kubernetes.io/projected/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-kube-api-access-v2wzn\") pod \"maas-controller-7864cdfb78-ptvts\" (UID: \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\") " pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:07.925211 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.925137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-webhook-cert\") pod \"maas-controller-7864cdfb78-ptvts\" (UID: \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\") " pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:07.927605 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.927585 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-webhook-cert\") pod \"maas-controller-7864cdfb78-ptvts\" (UID: \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\") " pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:07.932790 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.932767 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2wzn\" (UniqueName: \"kubernetes.io/projected/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-kube-api-access-v2wzn\") pod \"maas-controller-7864cdfb78-ptvts\" (UID: \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\") " pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:07.941818 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.941780 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:10:07.991688 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:07.991649 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:10:08.100318 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:08.100223 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:08.227016 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:08.226981 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert\") pod \"maas-controller-5bfb8c7b74-rt727\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:08.235020 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:08.230423 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert\") pod \"maas-controller-5bfb8c7b74-rt727\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:08.235020 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:08.233188 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7864cdfb78-ptvts"] Jul 14 01:10:08.237822 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:10:08.237798 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6a8222_c0e4_4334_85ab_ac72b41a73c1.slice/crio-cfc14db67a8c4dccfbb8702f3c734b25e039be23a4ea4f2f022e9958383f70f6 WatchSource:0}: Error finding container cfc14db67a8c4dccfbb8702f3c734b25e039be23a4ea4f2f022e9958383f70f6: Status 404 returned error can't find the container with id cfc14db67a8c4dccfbb8702f3c734b25e039be23a4ea4f2f022e9958383f70f6 Jul 14 01:10:08.467204 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:08.467161 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:08.489760 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:08.489726 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7864cdfb78-ptvts" event={"ID":"fe6a8222-c0e4-4334-85ab-ac72b41a73c1","Type":"ContainerStarted","Data":"cfc14db67a8c4dccfbb8702f3c734b25e039be23a4ea4f2f022e9958383f70f6"} Jul 14 01:10:08.597966 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:08.597939 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bfb8c7b74-rt727"] Jul 14 01:10:08.599527 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:10:08.599500 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f2e9ee_1dee_4080_bdaf_c3817065155c.slice/crio-673a2d618027dc5f4e22039871f2da84ae0e3f3569dab02a8f3f58faeee66233 WatchSource:0}: Error finding container 673a2d618027dc5f4e22039871f2da84ae0e3f3569dab02a8f3f58faeee66233: Status 404 returned error can't find the container with id 673a2d618027dc5f4e22039871f2da84ae0e3f3569dab02a8f3f58faeee66233 Jul 14 01:10:09.496302 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:09.496267 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" event={"ID":"f2f2e9ee-1dee-4080-bdaf-c3817065155c","Type":"ContainerStarted","Data":"673a2d618027dc5f4e22039871f2da84ae0e3f3569dab02a8f3f58faeee66233"} Jul 14 01:10:11.170597 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:11.170559 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:10:11.268034 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:11.267947 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:10:11.509344 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:11.509302 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7864cdfb78-ptvts" event={"ID":"fe6a8222-c0e4-4334-85ab-ac72b41a73c1","Type":"ContainerStarted","Data":"e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd"} Jul 14 01:10:11.509536 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:11.509368 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:11.510975 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:11.510948 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" event={"ID":"f2f2e9ee-1dee-4080-bdaf-c3817065155c","Type":"ContainerStarted","Data":"fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7"} Jul 14 01:10:11.511108 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:11.511053 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:11.529277 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:11.529175 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7864cdfb78-ptvts" podStartSLOduration=1.782667317 podStartE2EDuration="4.529157958s" totalImagesPullingTime="2.746490641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:11.527620647 +0000 UTC m=+659.398055840" watchObservedRunningTime="2026-07-14 01:10:11.529157958 +0000 UTC m=+659.399593147" Jul 14 01:10:11.546483 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:11.546432 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" podStartSLOduration=2.158477267 podStartE2EDuration="4.546410316s" totalImagesPullingTime="2.387933049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:11.544520582 +0000 UTC m=+659.414955802" watchObservedRunningTime="2026-07-14 01:10:11.546410316 +0000 UTC m=+659.416845505" Jul 14 01:10:22.517934 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:22.517883 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:10:22.518328 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:22.518141 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:22.577339 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:22.577307 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bfb8c7b74-rt727"] Jul 14 01:10:22.577590 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:22.577535 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" podUID="f2f2e9ee-1dee-4080-bdaf-c3817065155c" containerName="manager" containerID="cri-o://fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7" gracePeriod=30 Jul 14 01:10:23.364426 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.364394 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:23.456683 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.456647 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert\") pod \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " Jul 14 01:10:23.456865 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.456691 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jpt7\" (UniqueName: \"kubernetes.io/projected/f2f2e9ee-1dee-4080-bdaf-c3817065155c-kube-api-access-6jpt7\") pod \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\" (UID: \"f2f2e9ee-1dee-4080-bdaf-c3817065155c\") " Jul 14 01:10:23.459064 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.458998 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f2e9ee-1dee-4080-bdaf-c3817065155c-kube-api-access-6jpt7" (OuterVolumeSpecName: "kube-api-access-6jpt7") pod "f2f2e9ee-1dee-4080-bdaf-c3817065155c" (UID: "f2f2e9ee-1dee-4080-bdaf-c3817065155c"). InnerVolumeSpecName "kube-api-access-6jpt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:10:23.459184 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.459067 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f2f2e9ee-1dee-4080-bdaf-c3817065155c" (UID: "f2f2e9ee-1dee-4080-bdaf-c3817065155c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:10:23.557890 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.557853 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2f2e9ee-1dee-4080-bdaf-c3817065155c-webhook-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:10:23.557890 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.557882 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jpt7\" (UniqueName: \"kubernetes.io/projected/f2f2e9ee-1dee-4080-bdaf-c3817065155c-kube-api-access-6jpt7\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:10:23.570092 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.570059 2570 generic.go:356] "Generic (PLEG): container finished" podID="f2f2e9ee-1dee-4080-bdaf-c3817065155c" containerID="fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7" exitCode=0 Jul 14 01:10:23.570262 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.570104 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" Jul 14 01:10:23.570262 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.570144 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" event={"ID":"f2f2e9ee-1dee-4080-bdaf-c3817065155c","Type":"ContainerDied","Data":"fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7"} Jul 14 01:10:23.570262 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.570202 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb8c7b74-rt727" event={"ID":"f2f2e9ee-1dee-4080-bdaf-c3817065155c","Type":"ContainerDied","Data":"673a2d618027dc5f4e22039871f2da84ae0e3f3569dab02a8f3f58faeee66233"} Jul 14 01:10:23.570262 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.570234 2570 scope.go:117] "RemoveContainer" containerID="fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7" Jul 14 01:10:23.579949 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.579680 2570 scope.go:117] "RemoveContainer" containerID="fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7" Jul 14 01:10:23.580013 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:10:23.579976 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7\": container with ID starting with fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7 not found: ID does not exist" containerID="fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7" Jul 14 01:10:23.580055 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.580007 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7"} err="failed to get container status \"fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7\": rpc error: code = NotFound desc = could not find container \"fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7\": container with ID starting with fe3589bdda9a5086c76e96eda138600be672eb5c1ab37d7d6442f0f9d3eef4d7 not found: ID does not exist" Jul 14 01:10:23.591672 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.591648 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bfb8c7b74-rt727"] Jul 14 01:10:23.593555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:23.593531 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bfb8c7b74-rt727"] Jul 14 01:10:24.665312 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:24.665279 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f2e9ee-1dee-4080-bdaf-c3817065155c" path="/var/lib/kubelet/pods/f2f2e9ee-1dee-4080-bdaf-c3817065155c/volumes" Jul 14 01:10:44.981357 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:44.981322 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:10:45.601222 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.601189 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9"] Jul 14 01:10:45.601569 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.601553 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2f2e9ee-1dee-4080-bdaf-c3817065155c" containerName="manager" Jul 14 01:10:45.601569 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.601570 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2f2e9ee-1dee-4080-bdaf-c3817065155c" containerName="manager" Jul 14 01:10:45.601699 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.601633 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2f2e9ee-1dee-4080-bdaf-c3817065155c" containerName="manager" Jul 14 01:10:45.607769 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.607747 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.610053 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.610028 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 14 01:10:45.615098 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.615068 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9"] Jul 14 01:10:45.755213 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.755178 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/044b0514-af04-44d2-8b3c-adb84733e39b-openshift-service-ca\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.755213 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.755218 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044b0514-af04-44d2-8b3c-adb84733e39b-maas-api-tls\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.755446 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.755241 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqfts\" (UniqueName: \"kubernetes.io/projected/044b0514-af04-44d2-8b3c-adb84733e39b-kube-api-access-tqfts\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.856624 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.856538 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/044b0514-af04-44d2-8b3c-adb84733e39b-openshift-service-ca\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.856624 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.856575 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044b0514-af04-44d2-8b3c-adb84733e39b-maas-api-tls\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.856624 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.856595 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqfts\" (UniqueName: \"kubernetes.io/projected/044b0514-af04-44d2-8b3c-adb84733e39b-kube-api-access-tqfts\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.857406 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.857334 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/044b0514-af04-44d2-8b3c-adb84733e39b-openshift-service-ca\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.859279 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.859254 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/044b0514-af04-44d2-8b3c-adb84733e39b-maas-api-tls\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.864242 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.864219 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqfts\" (UniqueName: \"kubernetes.io/projected/044b0514-af04-44d2-8b3c-adb84733e39b-kube-api-access-tqfts\") pod \"maas-api-54d67896fb-7m4f9\" (UID: \"044b0514-af04-44d2-8b3c-adb84733e39b\") " pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:45.919606 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:45.919578 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:46.060969 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.060940 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9"] Jul 14 01:10:46.062731 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:10:46.062703 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044b0514_af04_44d2_8b3c_adb84733e39b.slice/crio-9041c0796461d826ff279999f3debe5c1135dabae9be40a56b06afda9ed8a19b WatchSource:0}: Error finding container 9041c0796461d826ff279999f3debe5c1135dabae9be40a56b06afda9ed8a19b: Status 404 returned error can't find the container with id 9041c0796461d826ff279999f3debe5c1135dabae9be40a56b06afda9ed8a19b Jul 14 01:10:46.248438 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.248402 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jdztw"] Jul 14 01:10:46.254641 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.254619 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:46.257899 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.257873 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 01:10:46.258067 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.257899 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hkfrh\"" Jul 14 01:10:46.261888 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.261860 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jdztw"] Jul 14 01:10:46.286613 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.286576 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-lmf6f"] Jul 14 01:10:46.290863 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.290844 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:46.299282 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.299254 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-lmf6f"] Jul 14 01:10:46.360874 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.360838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jdztw\" (UID: \"e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:46.361083 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.360891 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wq54\" (UniqueName: \"kubernetes.io/projected/e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3-kube-api-access-8wq54\") pod \"payload-pre-processing-74584bb9f8-jdztw\" (UID: \"e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:46.462317 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.462282 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jdztw\" (UID: \"e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:46.462529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.462328 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstn8\" (UniqueName: \"kubernetes.io/projected/7f5dda5f-7ac0-4093-90b4-8471dcedde05-kube-api-access-fstn8\") pod \"payload-processing-f9b8d9b9b-lmf6f\" (UID: \"7f5dda5f-7ac0-4093-90b4-8471dcedde05\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:46.462529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.462354 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wq54\" (UniqueName: \"kubernetes.io/projected/e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3-kube-api-access-8wq54\") pod \"payload-pre-processing-74584bb9f8-jdztw\" (UID: \"e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:46.462529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.462436 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5dda5f-7ac0-4093-90b4-8471dcedde05-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-lmf6f\" (UID: \"7f5dda5f-7ac0-4093-90b4-8471dcedde05\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:46.463022 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.462997 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jdztw\" (UID: \"e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:46.473472 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.473443 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wq54\" (UniqueName: \"kubernetes.io/projected/e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3-kube-api-access-8wq54\") pod \"payload-pre-processing-74584bb9f8-jdztw\" (UID: \"e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:46.563566 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.563469 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstn8\" (UniqueName: \"kubernetes.io/projected/7f5dda5f-7ac0-4093-90b4-8471dcedde05-kube-api-access-fstn8\") pod \"payload-processing-f9b8d9b9b-lmf6f\" (UID: \"7f5dda5f-7ac0-4093-90b4-8471dcedde05\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:46.563566 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.563528 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5dda5f-7ac0-4093-90b4-8471dcedde05-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-lmf6f\" (UID: \"7f5dda5f-7ac0-4093-90b4-8471dcedde05\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:46.564228 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.564207 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5dda5f-7ac0-4093-90b4-8471dcedde05-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-lmf6f\" (UID: \"7f5dda5f-7ac0-4093-90b4-8471dcedde05\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:46.567372 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.567345 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:46.571342 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.571315 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstn8\" (UniqueName: \"kubernetes.io/projected/7f5dda5f-7ac0-4093-90b4-8471dcedde05-kube-api-access-fstn8\") pod \"payload-processing-f9b8d9b9b-lmf6f\" (UID: \"7f5dda5f-7ac0-4093-90b4-8471dcedde05\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:46.601511 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.601475 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:46.684469 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.684431 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" event={"ID":"044b0514-af04-44d2-8b3c-adb84733e39b","Type":"ContainerStarted","Data":"9041c0796461d826ff279999f3debe5c1135dabae9be40a56b06afda9ed8a19b"} Jul 14 01:10:46.726436 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.726366 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jdztw"] Jul 14 01:10:46.729278 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:10:46.729243 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26dc2ba_9cef_4c3e_9951_f8e25d6b50d3.slice/crio-2b84579150f8fcef4861be9aa003ecd2ee97ebefd9b021afbe3a013b81728ba8 WatchSource:0}: Error finding container 2b84579150f8fcef4861be9aa003ecd2ee97ebefd9b021afbe3a013b81728ba8: Status 404 returned error can't find the container with id 2b84579150f8fcef4861be9aa003ecd2ee97ebefd9b021afbe3a013b81728ba8 Jul 14 01:10:46.762367 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:46.762340 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-lmf6f"] Jul 14 01:10:46.764281 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:10:46.764251 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5dda5f_7ac0_4093_90b4_8471dcedde05.slice/crio-7b48672aa2d98744a4884a5c6f57d276e678ad8ff214225de3af909b484cca15 WatchSource:0}: Error finding container 7b48672aa2d98744a4884a5c6f57d276e678ad8ff214225de3af909b484cca15: Status 404 returned error can't find the container with id 7b48672aa2d98744a4884a5c6f57d276e678ad8ff214225de3af909b484cca15 Jul 14 01:10:47.090082 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:47.090035 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:10:47.707998 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:47.707868 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" event={"ID":"e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3","Type":"ContainerStarted","Data":"2b84579150f8fcef4861be9aa003ecd2ee97ebefd9b021afbe3a013b81728ba8"} Jul 14 01:10:47.711080 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:47.710995 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" event={"ID":"7f5dda5f-7ac0-4093-90b4-8471dcedde05","Type":"ContainerStarted","Data":"7b48672aa2d98744a4884a5c6f57d276e678ad8ff214225de3af909b484cca15"} Jul 14 01:10:49.723074 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.723017 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" event={"ID":"044b0514-af04-44d2-8b3c-adb84733e39b","Type":"ContainerStarted","Data":"985d8a5ffd47074f68ea3d18a82d84041c33dc25323c10df89c1f436b7b7f928"} Jul 14 01:10:49.723549 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.723152 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:49.724567 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.724537 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" event={"ID":"e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3","Type":"ContainerStarted","Data":"a1278ecce9b7714d53be5e1d364e3f24aa1507c206bae9f07e2f26c8779088a1"} Jul 14 01:10:49.724704 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.724598 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:10:49.726301 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.726275 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" event={"ID":"7f5dda5f-7ac0-4093-90b4-8471dcedde05","Type":"ContainerStarted","Data":"566c6a65987ecfc5f1597f7c87281d2ba9793667d42277dc9d77432ab975a3b5"} Jul 14 01:10:49.726415 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.726317 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:10:49.739037 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.738989 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" podStartSLOduration=1.908369804 podStartE2EDuration="4.738964894s" totalImagesPullingTime="2.83059509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:49.738310849 +0000 UTC m=+697.608746055" watchObservedRunningTime="2026-07-14 01:10:49.738964894 +0000 UTC m=+697.609400086" Jul 14 01:10:49.753634 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.753580 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" podStartSLOduration=1.588120068 podStartE2EDuration="3.753561856s" totalImagesPullingTime="2.165441788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:49.751982133 +0000 UTC m=+697.622417338" watchObservedRunningTime="2026-07-14 01:10:49.753561856 +0000 UTC m=+697.623997047" Jul 14 01:10:49.767067 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:49.767012 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" podStartSLOduration=1.6398024740000001 podStartE2EDuration="3.766993138s" totalImagesPullingTime="2.127190664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:10:49.765526958 +0000 UTC m=+697.635962168" watchObservedRunningTime="2026-07-14 01:10:49.766993138 +0000 UTC m=+697.637428329" Jul 14 01:10:53.263171 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:53.263117 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b67qf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 01:10:53.263595 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:53.263194 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" podUID="a7ce7b50-7732-4475-8577-d986d4612aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 01:10:54.758294 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:54.758262 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7ce7b50-7732-4475-8577-d986d4612aee" containerID="99fd4bb3fd4f1428d6cb1b16dc68ec0c5ea747c35f8cf23b2641b09af7739263" exitCode=0 Jul 14 01:10:54.758742 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:54.758341 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" event={"ID":"a7ce7b50-7732-4475-8577-d986d4612aee","Type":"ContainerDied","Data":"99fd4bb3fd4f1428d6cb1b16dc68ec0c5ea747c35f8cf23b2641b09af7739263"} Jul 14 01:10:54.758742 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:54.758719 2570 scope.go:117] "RemoveContainer" containerID="99fd4bb3fd4f1428d6cb1b16dc68ec0c5ea747c35f8cf23b2641b09af7739263" Jul 14 01:10:54.759747 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:54.759718 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:10:54.759812 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:54.759791 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:10:54.759849 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:54.759825 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:10:55.737317 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:55.737285 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54d67896fb-7m4f9" Jul 14 01:10:55.767065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:55.767029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" event={"ID":"a7ce7b50-7732-4475-8577-d986d4612aee","Type":"ContainerStarted","Data":"c77b1d0756863026ec0ab865de7b5735671e109188767a0c313ba39a61cacc2d"} Jul 14 01:10:55.939191 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:55.939149 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:10:55.939397 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:55.939374 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b67qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 14 01:10:55.939453 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:55.939434 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" podUID="a7ce7b50-7732-4475-8577-d986d4612aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 14 01:10:56.939493 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:56.939459 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b67qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 14 01:10:56.940020 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:56.939519 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" podUID="a7ce7b50-7732-4475-8577-d986d4612aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 14 01:10:57.198691 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:57.198585 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:10:57.297823 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:57.297791 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:10:57.939691 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:57.939646 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b67qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 14 01:10:57.940199 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:57.939712 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" podUID="a7ce7b50-7732-4475-8577-d986d4612aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 14 01:10:58.940008 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:58.939969 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b67qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 14 01:10:58.940418 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:58.940028 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" podUID="a7ce7b50-7732-4475-8577-d986d4612aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 14 01:10:59.943394 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:59.943363 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:10:59.943795 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:59.943649 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:10:59.944427 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:10:59.944403 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b67qf" Jul 14 01:11:00.733622 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:00.733594 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-lmf6f" Jul 14 01:11:00.733901 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:00.733883 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jdztw" Jul 14 01:11:09.720026 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.719930 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f"] Jul 14 01:11:09.725552 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.725520 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.728513 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.728485 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f"] Jul 14 01:11:09.729232 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.729208 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 01:11:09.729350 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.729235 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 01:11:09.729350 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.729238 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 01:11:09.729350 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.729208 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-48wgh\"" Jul 14 01:11:09.789638 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.789602 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.789824 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.789671 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.789824 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.789697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.789824 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.789730 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9qn\" (UniqueName: \"kubernetes.io/projected/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-kube-api-access-mq9qn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.789824 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.789809 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.790024 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.789878 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.828719 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.828686 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:11:09.890993 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.890951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.891181 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.891008 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.891181 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.891032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9qn\" (UniqueName: \"kubernetes.io/projected/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-kube-api-access-mq9qn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.891181 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.891064 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.891181 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.891095 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.891181 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.891151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.891511 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.891478 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.891585 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.891507 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.891585 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.891529 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.893466 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.893440 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.893737 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.893712 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:09.899137 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:09.899112 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9qn\" (UniqueName: \"kubernetes.io/projected/a7fd67dd-0d40-42e7-b35d-30d0484f3bc4-kube-api-access-mq9qn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f\" (UID: \"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:10.036975 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:10.036864 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:10.176634 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:10.176607 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f"] Jul 14 01:11:10.178571 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:11:10.178534 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7fd67dd_0d40_42e7_b35d_30d0484f3bc4.slice/crio-3c7d6dd119bc6d4a1a21f2d713dc5a1db9ed2361e7179333d7df57a30a7d3058 WatchSource:0}: Error finding container 3c7d6dd119bc6d4a1a21f2d713dc5a1db9ed2361e7179333d7df57a30a7d3058: Status 404 returned error can't find the container with id 3c7d6dd119bc6d4a1a21f2d713dc5a1db9ed2361e7179333d7df57a30a7d3058 Jul 14 01:11:10.854484 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:10.854446 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" event={"ID":"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4","Type":"ContainerStarted","Data":"3c7d6dd119bc6d4a1a21f2d713dc5a1db9ed2361e7179333d7df57a30a7d3058"} Jul 14 01:11:11.861702 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:11.861666 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" event={"ID":"a7fd67dd-0d40-42e7-b35d-30d0484f3bc4","Type":"ContainerStarted","Data":"53132d7d80d80503f3c50daffba3b8186e44965a4d5c2e25333cb8b94d349f9e"} Jul 14 01:11:11.877908 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:11.877851 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" podStartSLOduration=1.796576597 podStartE2EDuration="2.877835355s" totalImagesPullingTime="1.081258758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:11:11.877147373 +0000 UTC m=+719.747582567" watchObservedRunningTime="2026-07-14 01:11:11.877835355 +0000 UTC m=+719.748270547" Jul 14 01:11:19.525527 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.525490 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf"] Jul 14 01:11:19.531007 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.530989 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.533657 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.533536 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 14 01:11:19.537132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.537104 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf"] Jul 14 01:11:19.560280 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.560246 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:11:19.570667 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.570644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.570771 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.570716 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.570771 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.570752 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.570841 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.570779 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbk4j\" (UniqueName: \"kubernetes.io/projected/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-kube-api-access-fbk4j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.570841 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.570806 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.570841 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.570824 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.671905 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.671872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.672093 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.671964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.672093 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.672001 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbk4j\" (UniqueName: \"kubernetes.io/projected/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-kube-api-access-fbk4j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.672093 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.672032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.672093 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.672063 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.672314 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.672246 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.672473 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.672449 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.672600 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.672579 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.672660 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.672584 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.674763 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.674739 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.674882 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.674782 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.679752 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.679730 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbk4j\" (UniqueName: \"kubernetes.io/projected/e0f5eb57-d59d-453c-b4ec-d0160c2a3562-kube-api-access-fbk4j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rqcqf\" (UID: \"e0f5eb57-d59d-453c-b4ec-d0160c2a3562\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.844389 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.844311 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:19.981539 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:19.981516 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf"] Jul 14 01:11:19.983587 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:11:19.983562 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f5eb57_d59d_453c_b4ec_d0160c2a3562.slice/crio-808d82cddce3c4cd2da120c28d137ed79c2b3c403ce03539cec12877b9160824 WatchSource:0}: Error finding container 808d82cddce3c4cd2da120c28d137ed79c2b3c403ce03539cec12877b9160824: Status 404 returned error can't find the container with id 808d82cddce3c4cd2da120c28d137ed79c2b3c403ce03539cec12877b9160824 Jul 14 01:11:20.037342 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:20.037310 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:20.037495 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:20.037365 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:20.049885 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:20.049858 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:20.908630 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:20.908591 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" event={"ID":"e0f5eb57-d59d-453c-b4ec-d0160c2a3562","Type":"ContainerStarted","Data":"138d1f87c10e8379d472b33611e498f46f908f5aa3f7c5954d49c999fa507e55"} Jul 14 01:11:20.909135 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:20.908653 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" event={"ID":"e0f5eb57-d59d-453c-b4ec-d0160c2a3562","Type":"ContainerStarted","Data":"808d82cddce3c4cd2da120c28d137ed79c2b3c403ce03539cec12877b9160824"} Jul 14 01:11:20.920191 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:20.920168 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f" Jul 14 01:11:20.924993 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:20.924951 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" podStartSLOduration=1.7421755349999999 podStartE2EDuration="1.924935512s" totalImagesPullingTime="182.759977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:11:20.924165832 +0000 UTC m=+728.794601023" watchObservedRunningTime="2026-07-14 01:11:20.924935512 +0000 UTC m=+728.795370697" Jul 14 01:11:29.844799 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:29.844760 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:29.845229 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:29.844817 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:29.857275 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:29.857253 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:29.964730 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:29.964694 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rqcqf" Jul 14 01:11:33.860313 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:33.860277 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:11:36.248570 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:36.248503 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:11:47.328340 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.328302 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz"] Jul 14 01:11:47.334727 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.334702 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.337366 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.337334 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 14 01:11:47.341972 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.341945 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz"] Jul 14 01:11:47.359889 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.359849 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:11:47.420795 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.420759 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.420999 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.420819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.420999 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.420896 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.420999 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.420958 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11854795-537a-4d09-a661-c3a67af5eb20-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.420999 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.420984 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcq4m\" (UniqueName: \"kubernetes.io/projected/11854795-537a-4d09-a661-c3a67af5eb20-kube-api-access-mcq4m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.421152 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.421030 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.521816 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.521771 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.522028 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.521841 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.522028 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.521865 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.522028 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.521881 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11854795-537a-4d09-a661-c3a67af5eb20-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.522028 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.521903 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcq4m\" (UniqueName: \"kubernetes.io/projected/11854795-537a-4d09-a661-c3a67af5eb20-kube-api-access-mcq4m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.522028 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.521977 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.522284 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.522268 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.522339 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.522296 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.522392 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.522336 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.524472 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.524451 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11854795-537a-4d09-a661-c3a67af5eb20-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.524705 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.524682 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11854795-537a-4d09-a661-c3a67af5eb20-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.529529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.529502 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcq4m\" (UniqueName: \"kubernetes.io/projected/11854795-537a-4d09-a661-c3a67af5eb20-kube-api-access-mcq4m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz\" (UID: \"11854795-537a-4d09-a661-c3a67af5eb20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.650560 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.650460 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:47.793550 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:47.793527 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz"] Jul 14 01:11:47.795216 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:11:47.795192 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11854795_537a_4d09_a661_c3a67af5eb20.slice/crio-8547e5535ac7d9a5d78a05b14d7cdfa9cb2d2dc31287162f698097631b9db3d8 WatchSource:0}: Error finding container 8547e5535ac7d9a5d78a05b14d7cdfa9cb2d2dc31287162f698097631b9db3d8: Status 404 returned error can't find the container with id 8547e5535ac7d9a5d78a05b14d7cdfa9cb2d2dc31287162f698097631b9db3d8 Jul 14 01:11:48.047386 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:48.047347 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" event={"ID":"11854795-537a-4d09-a661-c3a67af5eb20","Type":"ContainerStarted","Data":"dde985ee99e2aa29765c5b39f34c167c7483295867b3fcb3adc77743da14806d"} Jul 14 01:11:48.047521 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:48.047450 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" event={"ID":"11854795-537a-4d09-a661-c3a67af5eb20","Type":"ContainerStarted","Data":"8547e5535ac7d9a5d78a05b14d7cdfa9cb2d2dc31287162f698097631b9db3d8"} Jul 14 01:11:48.065848 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:48.065792 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" podStartSLOduration=0.8876261 podStartE2EDuration="1.065773912s" totalImagesPullingTime="178.147812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:11:48.062609239 +0000 UTC m=+755.933044432" watchObservedRunningTime="2026-07-14 01:11:48.065773912 +0000 UTC m=+755.936209108" Jul 14 01:11:57.537436 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:57.537399 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:11:57.651368 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:57.651331 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:57.651543 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:57.651393 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:57.663463 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:57.663434 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:58.110340 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:58.110312 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz" Jul 14 01:11:59.870934 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:59.870873 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:11:59.971255 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:11:59.971224 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:12:12.352568 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:12:12.352525 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:13:05.267066 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.267020 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-579bd69b44-2pvn2"] Jul 14 01:13:05.270817 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.270790 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-579bd69b44-2pvn2" Jul 14 01:13:05.274235 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.274205 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dncbs\"" Jul 14 01:13:05.274540 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.274307 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 01:13:05.277012 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.276985 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-579bd69b44-2pvn2"] Jul 14 01:13:05.320715 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.320675 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e997440-f92a-4e59-9425-6ae163f4e5bc-tls-cert\") pod \"authorino-579bd69b44-2pvn2\" (UID: \"8e997440-f92a-4e59-9425-6ae163f4e5bc\") " pod="kuadrant-system/authorino-579bd69b44-2pvn2" Jul 14 01:13:05.320880 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.320731 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjdj5\" (UniqueName: \"kubernetes.io/projected/8e997440-f92a-4e59-9425-6ae163f4e5bc-kube-api-access-zjdj5\") pod \"authorino-579bd69b44-2pvn2\" (UID: \"8e997440-f92a-4e59-9425-6ae163f4e5bc\") " pod="kuadrant-system/authorino-579bd69b44-2pvn2" Jul 14 01:13:05.421518 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.421484 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e997440-f92a-4e59-9425-6ae163f4e5bc-tls-cert\") pod \"authorino-579bd69b44-2pvn2\" (UID: \"8e997440-f92a-4e59-9425-6ae163f4e5bc\") " pod="kuadrant-system/authorino-579bd69b44-2pvn2" Jul 14 01:13:05.421518 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.421529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjdj5\" (UniqueName: \"kubernetes.io/projected/8e997440-f92a-4e59-9425-6ae163f4e5bc-kube-api-access-zjdj5\") pod \"authorino-579bd69b44-2pvn2\" (UID: \"8e997440-f92a-4e59-9425-6ae163f4e5bc\") " pod="kuadrant-system/authorino-579bd69b44-2pvn2" Jul 14 01:13:05.424132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.424110 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8e997440-f92a-4e59-9425-6ae163f4e5bc-tls-cert\") pod \"authorino-579bd69b44-2pvn2\" (UID: \"8e997440-f92a-4e59-9425-6ae163f4e5bc\") " pod="kuadrant-system/authorino-579bd69b44-2pvn2" Jul 14 01:13:05.429277 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.429247 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjdj5\" (UniqueName: \"kubernetes.io/projected/8e997440-f92a-4e59-9425-6ae163f4e5bc-kube-api-access-zjdj5\") pod \"authorino-579bd69b44-2pvn2\" (UID: \"8e997440-f92a-4e59-9425-6ae163f4e5bc\") " pod="kuadrant-system/authorino-579bd69b44-2pvn2" Jul 14 01:13:05.581020 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.580934 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-579bd69b44-2pvn2" Jul 14 01:13:05.671166 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.671133 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:13:05.717191 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.717164 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-579bd69b44-2pvn2"] Jul 14 01:13:05.718659 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:13:05.718623 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e997440_f92a_4e59_9425_6ae163f4e5bc.slice/crio-f447d68bb6276aaf93043a4399bf65047d0d6c42d80bab6f203b3ea3401fd307 WatchSource:0}: Error finding container f447d68bb6276aaf93043a4399bf65047d0d6c42d80bab6f203b3ea3401fd307: Status 404 returned error can't find the container with id f447d68bb6276aaf93043a4399bf65047d0d6c42d80bab6f203b3ea3401fd307 Jul 14 01:13:05.770068 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:05.770030 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:13:06.452264 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:06.452227 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-579bd69b44-2pvn2" event={"ID":"8e997440-f92a-4e59-9425-6ae163f4e5bc","Type":"ContainerStarted","Data":"fdbf8e204fff77c297d45bc9b4155a05bc26c893721286f00344ffa99d8ef03e"} Jul 14 01:13:06.452750 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:06.452276 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-579bd69b44-2pvn2" event={"ID":"8e997440-f92a-4e59-9425-6ae163f4e5bc","Type":"ContainerStarted","Data":"f447d68bb6276aaf93043a4399bf65047d0d6c42d80bab6f203b3ea3401fd307"} Jul 14 01:13:06.473797 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:06.473734 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-579bd69b44-2pvn2" podStartSLOduration=0.960564338 podStartE2EDuration="1.473712403s" totalImagesPullingTime="513.148065ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:13:06.469933878 +0000 UTC m=+834.340369060" watchObservedRunningTime="2026-07-14 01:13:06.473712403 +0000 UTC m=+834.344147593" Jul 14 01:13:06.889621 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:06.889579 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:13:06.987675 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:06.987632 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:13:12.870100 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:12.870056 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:13:12.971313 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:12.971275 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:13:25.405169 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:13:25.405126 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:14:13.206769 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:13.206728 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:14:13.257977 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:13.257939 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:14:18.356082 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.356043 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:14:18.478635 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.478589 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7864cdfb78-ptvts"] Jul 14 01:14:18.478884 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.478821 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7864cdfb78-ptvts" podUID="fe6a8222-c0e4-4334-85ab-ac72b41a73c1" containerName="manager" containerID="cri-o://e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd" gracePeriod=30 Jul 14 01:14:18.728377 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.728353 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:14:18.829978 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.829941 2570 generic.go:356] "Generic (PLEG): container finished" podID="fe6a8222-c0e4-4334-85ab-ac72b41a73c1" containerID="e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd" exitCode=0 Jul 14 01:14:18.830172 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.829986 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7864cdfb78-ptvts" Jul 14 01:14:18.830172 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.830022 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7864cdfb78-ptvts" event={"ID":"fe6a8222-c0e4-4334-85ab-ac72b41a73c1","Type":"ContainerDied","Data":"e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd"} Jul 14 01:14:18.830172 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.830079 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7864cdfb78-ptvts" event={"ID":"fe6a8222-c0e4-4334-85ab-ac72b41a73c1","Type":"ContainerDied","Data":"cfc14db67a8c4dccfbb8702f3c734b25e039be23a4ea4f2f022e9958383f70f6"} Jul 14 01:14:18.830172 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.830108 2570 scope.go:117] "RemoveContainer" containerID="e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd" Jul 14 01:14:18.839062 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.839045 2570 scope.go:117] "RemoveContainer" containerID="e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd" Jul 14 01:14:18.839311 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:14:18.839295 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd\": container with ID starting with e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd not found: ID does not exist" containerID="e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd" Jul 14 01:14:18.839368 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.839321 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd"} err="failed to get container status \"e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd\": rpc error: code = NotFound desc = could not find container \"e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd\": container with ID starting with e7d8658376c4d486abfb96e6fa41ae16372437c3a29e762e3bc952fdfe3272cd not found: ID does not exist" Jul 14 01:14:18.876637 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.876610 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2wzn\" (UniqueName: \"kubernetes.io/projected/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-kube-api-access-v2wzn\") pod \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\" (UID: \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\") " Jul 14 01:14:18.876742 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.876687 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-webhook-cert\") pod \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\" (UID: \"fe6a8222-c0e4-4334-85ab-ac72b41a73c1\") " Jul 14 01:14:18.878704 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.878672 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-kube-api-access-v2wzn" (OuterVolumeSpecName: "kube-api-access-v2wzn") pod "fe6a8222-c0e4-4334-85ab-ac72b41a73c1" (UID: "fe6a8222-c0e4-4334-85ab-ac72b41a73c1"). InnerVolumeSpecName "kube-api-access-v2wzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:14:18.878797 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.878739 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe6a8222-c0e4-4334-85ab-ac72b41a73c1" (UID: "fe6a8222-c0e4-4334-85ab-ac72b41a73c1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:14:18.978095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.978069 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-webhook-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:14:18.978095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:18.978097 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2wzn\" (UniqueName: \"kubernetes.io/projected/fe6a8222-c0e4-4334-85ab-ac72b41a73c1-kube-api-access-v2wzn\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:14:19.151873 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:19.151847 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7864cdfb78-ptvts"] Jul 14 01:14:19.153791 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:19.153770 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7864cdfb78-ptvts"] Jul 14 01:14:19.885152 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:19.885079 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:14:20.014612 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.014576 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7864cdfb78-74dcc"] Jul 14 01:14:20.014968 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.014953 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe6a8222-c0e4-4334-85ab-ac72b41a73c1" containerName="manager" Jul 14 01:14:20.014968 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.014968 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe6a8222-c0e4-4334-85ab-ac72b41a73c1" containerName="manager" Jul 14 01:14:20.015054 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.015048 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe6a8222-c0e4-4334-85ab-ac72b41a73c1" containerName="manager" Jul 14 01:14:20.019419 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.019401 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:20.023194 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.023173 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 14 01:14:20.023319 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.023174 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 14 01:14:20.023319 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.023174 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6qb7q\"" Jul 14 01:14:20.027858 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.027836 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7864cdfb78-74dcc"] Jul 14 01:14:20.190342 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.190311 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f38d2bca-19b6-454f-a4b5-d563b5a378bd-webhook-cert\") pod \"maas-controller-7864cdfb78-74dcc\" (UID: \"f38d2bca-19b6-454f-a4b5-d563b5a378bd\") " pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:20.190511 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.190358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf5xp\" (UniqueName: \"kubernetes.io/projected/f38d2bca-19b6-454f-a4b5-d563b5a378bd-kube-api-access-vf5xp\") pod \"maas-controller-7864cdfb78-74dcc\" (UID: \"f38d2bca-19b6-454f-a4b5-d563b5a378bd\") " pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:20.291243 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.291210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f38d2bca-19b6-454f-a4b5-d563b5a378bd-webhook-cert\") pod \"maas-controller-7864cdfb78-74dcc\" (UID: \"f38d2bca-19b6-454f-a4b5-d563b5a378bd\") " pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:20.291410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.291256 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf5xp\" (UniqueName: \"kubernetes.io/projected/f38d2bca-19b6-454f-a4b5-d563b5a378bd-kube-api-access-vf5xp\") pod \"maas-controller-7864cdfb78-74dcc\" (UID: \"f38d2bca-19b6-454f-a4b5-d563b5a378bd\") " pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:20.293924 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.293895 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f38d2bca-19b6-454f-a4b5-d563b5a378bd-webhook-cert\") pod \"maas-controller-7864cdfb78-74dcc\" (UID: \"f38d2bca-19b6-454f-a4b5-d563b5a378bd\") " pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:20.304884 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.304859 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf5xp\" (UniqueName: \"kubernetes.io/projected/f38d2bca-19b6-454f-a4b5-d563b5a378bd-kube-api-access-vf5xp\") pod \"maas-controller-7864cdfb78-74dcc\" (UID: \"f38d2bca-19b6-454f-a4b5-d563b5a378bd\") " pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:20.331498 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.331471 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:20.467562 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.467532 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7864cdfb78-74dcc"] Jul 14 01:14:20.468948 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:14:20.468905 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38d2bca_19b6_454f_a4b5_d563b5a378bd.slice/crio-52c0da5b6bd4f2bee1560bd2916edceab9cc1da4f9f8383370d382928c8c2e89 WatchSource:0}: Error finding container 52c0da5b6bd4f2bee1560bd2916edceab9cc1da4f9f8383370d382928c8c2e89: Status 404 returned error can't find the container with id 52c0da5b6bd4f2bee1560bd2916edceab9cc1da4f9f8383370d382928c8c2e89 Jul 14 01:14:20.671153 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.667555 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe6a8222-c0e4-4334-85ab-ac72b41a73c1" path="/var/lib/kubelet/pods/fe6a8222-c0e4-4334-85ab-ac72b41a73c1/volumes" Jul 14 01:14:20.842532 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:20.842442 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7864cdfb78-74dcc" event={"ID":"f38d2bca-19b6-454f-a4b5-d563b5a378bd","Type":"ContainerStarted","Data":"52c0da5b6bd4f2bee1560bd2916edceab9cc1da4f9f8383370d382928c8c2e89"} Jul 14 01:14:21.851802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:21.851770 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7864cdfb78-74dcc" event={"ID":"f38d2bca-19b6-454f-a4b5-d563b5a378bd","Type":"ContainerStarted","Data":"e5af2850e310751983bb26221eae8c80ea0f144ffdca60053f5b8007f0e17349"} Jul 14 01:14:21.852234 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:21.851945 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:14:21.870341 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:21.870293 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7864cdfb78-74dcc" podStartSLOduration=2.370517467 podStartE2EDuration="2.870279662s" totalImagesPullingTime="499.762195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:14:21.868129188 +0000 UTC m=+909.738564379" watchObservedRunningTime="2026-07-14 01:14:21.870279662 +0000 UTC m=+909.740714867" Jul 14 01:14:23.225078 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:23.225041 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:14:23.280883 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:23.280847 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:14:32.860086 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:14:32.860055 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7864cdfb78-74dcc" Jul 14 01:15:01.710707 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:01.710667 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:01.813233 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:01.813193 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:02.016797 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:02.016711 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:07.652480 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:07.652446 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:07.718200 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:07.718168 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:07.803350 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:07.803308 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:07.906339 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:07.906247 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:08.006099 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:08.006063 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:13.609289 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:13.609244 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:13.710183 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:13.710149 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:15:53.863611 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:15:53.863573 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:20:05.425491 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:20:05.425364 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:20:05.542803 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:20:05.542765 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:22:02.738604 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:22:02.738521 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:22:52.594305 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:22:52.594255 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:25:55.720842 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:25:55.720810 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:02.431886 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:02.431852 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:10.690098 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:10.690063 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:15.800353 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:15.800298 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:18.712345 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:18.712312 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:18.811215 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:18.811179 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:19.152093 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:19.152008 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:24.805625 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:24.805580 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:24.869288 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:24.869252 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:25.009540 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:25.009513 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:25.110247 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:25.110165 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:26.197760 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.197719 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:26.269720 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.269693 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk"] Jul 14 01:26:26.273421 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.273400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.275678 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.275656 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c626eb13-serving-cert\"" Jul 14 01:26:26.275678 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.275673 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nvgxn\"" Jul 14 01:26:26.283401 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.283372 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk"] Jul 14 01:26:26.288070 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.288045 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:26.354642 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.354608 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:26.435881 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.435846 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be183f4-7730-449f-9991-82bf254c9acc-maas-api-tls\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.436096 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.435979 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be183f4-7730-449f-9991-82bf254c9acc-openshift-service-ca\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.436096 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.436031 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxhlp\" (UniqueName: \"kubernetes.io/projected/5be183f4-7730-449f-9991-82bf254c9acc-kube-api-access-zxhlp\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.537380 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.537294 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhlp\" (UniqueName: \"kubernetes.io/projected/5be183f4-7730-449f-9991-82bf254c9acc-kube-api-access-zxhlp\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.537380 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.537340 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be183f4-7730-449f-9991-82bf254c9acc-maas-api-tls\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.537557 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.537400 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be183f4-7730-449f-9991-82bf254c9acc-openshift-service-ca\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.537997 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.537979 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be183f4-7730-449f-9991-82bf254c9acc-openshift-service-ca\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.540014 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.539981 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be183f4-7730-449f-9991-82bf254c9acc-maas-api-tls\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.545900 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.545874 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxhlp\" (UniqueName: \"kubernetes.io/projected/5be183f4-7730-449f-9991-82bf254c9acc-kube-api-access-zxhlp\") pod \"maas-api-e2e-ait-c626eb13-5776879c77-rc4gk\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.556464 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.556439 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:26.587047 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.587007 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:26.734463 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.734436 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk"] Jul 14 01:26:26.736091 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:26:26.736066 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be183f4_7730_449f_9991_82bf254c9acc.slice/crio-eb71b55a805cce58e457ffa5432b559e6a6e1f1f677d34190c562de47f7dec63 WatchSource:0}: Error finding container eb71b55a805cce58e457ffa5432b559e6a6e1f1f677d34190c562de47f7dec63: Status 404 returned error can't find the container with id eb71b55a805cce58e457ffa5432b559e6a6e1f1f677d34190c562de47f7dec63 Jul 14 01:26:26.737446 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.737427 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 01:26:26.755892 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.755857 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:26.856376 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:26.856296 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:27.659783 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:27.659691 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" event={"ID":"5be183f4-7730-449f-9991-82bf254c9acc","Type":"ContainerStarted","Data":"6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1"} Jul 14 01:26:27.659783 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:27.659745 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" event={"ID":"5be183f4-7730-449f-9991-82bf254c9acc","Type":"ContainerStarted","Data":"eb71b55a805cce58e457ffa5432b559e6a6e1f1f677d34190c562de47f7dec63"} Jul 14 01:26:27.660192 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:27.659807 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:27.679488 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:27.679440 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" podStartSLOduration=1.196753626 podStartE2EDuration="1.679426353s" totalImagesPullingTime="482.672727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:26:27.677715784 +0000 UTC m=+1635.548150974" watchObservedRunningTime="2026-07-14 01:26:27.679426353 +0000 UTC m=+1635.549861543" Jul 14 01:26:28.707327 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:28.707296 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:33.671982 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:33.671950 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:41.784750 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:41.784718 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk"] Jul 14 01:26:41.785255 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:41.784989 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" podUID="5be183f4-7730-449f-9991-82bf254c9acc" containerName="maas-api" containerID="cri-o://6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1" gracePeriod=30 Jul 14 01:26:41.810292 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:41.810261 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:42.043648 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.043579 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:42.077560 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.077524 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxhlp\" (UniqueName: \"kubernetes.io/projected/5be183f4-7730-449f-9991-82bf254c9acc-kube-api-access-zxhlp\") pod \"5be183f4-7730-449f-9991-82bf254c9acc\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " Jul 14 01:26:42.077760 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.077629 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be183f4-7730-449f-9991-82bf254c9acc-maas-api-tls\") pod \"5be183f4-7730-449f-9991-82bf254c9acc\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " Jul 14 01:26:42.077760 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.077700 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be183f4-7730-449f-9991-82bf254c9acc-openshift-service-ca\") pod \"5be183f4-7730-449f-9991-82bf254c9acc\" (UID: \"5be183f4-7730-449f-9991-82bf254c9acc\") " Jul 14 01:26:42.078161 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.078129 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5be183f4-7730-449f-9991-82bf254c9acc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5be183f4-7730-449f-9991-82bf254c9acc" (UID: "5be183f4-7730-449f-9991-82bf254c9acc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:26:42.080533 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.080507 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5be183f4-7730-449f-9991-82bf254c9acc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5be183f4-7730-449f-9991-82bf254c9acc" (UID: "5be183f4-7730-449f-9991-82bf254c9acc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 01:26:42.080655 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.080588 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be183f4-7730-449f-9991-82bf254c9acc-kube-api-access-zxhlp" (OuterVolumeSpecName: "kube-api-access-zxhlp") pod "5be183f4-7730-449f-9991-82bf254c9acc" (UID: "5be183f4-7730-449f-9991-82bf254c9acc"). InnerVolumeSpecName "kube-api-access-zxhlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:26:42.178447 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.178409 2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5be183f4-7730-449f-9991-82bf254c9acc-openshift-service-ca\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:26:42.178447 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.178439 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxhlp\" (UniqueName: \"kubernetes.io/projected/5be183f4-7730-449f-9991-82bf254c9acc-kube-api-access-zxhlp\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:26:42.178447 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.178454 2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5be183f4-7730-449f-9991-82bf254c9acc-maas-api-tls\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:26:42.738959 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.738899 2570 generic.go:356] "Generic (PLEG): container finished" podID="5be183f4-7730-449f-9991-82bf254c9acc" containerID="6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1" exitCode=0 Jul 14 01:26:42.739125 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.738959 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" event={"ID":"5be183f4-7730-449f-9991-82bf254c9acc","Type":"ContainerDied","Data":"6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1"} Jul 14 01:26:42.739125 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.738982 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" Jul 14 01:26:42.739125 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.739015 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk" event={"ID":"5be183f4-7730-449f-9991-82bf254c9acc","Type":"ContainerDied","Data":"eb71b55a805cce58e457ffa5432b559e6a6e1f1f677d34190c562de47f7dec63"} Jul 14 01:26:42.739125 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.739037 2570 scope.go:117] "RemoveContainer" containerID="6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1" Jul 14 01:26:42.748687 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.748669 2570 scope.go:117] "RemoveContainer" containerID="6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1" Jul 14 01:26:42.748974 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:26:42.748956 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1\": container with ID starting with 6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1 not found: ID does not exist" containerID="6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1" Jul 14 01:26:42.749057 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.748982 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1"} err="failed to get container status \"6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1\": rpc error: code = NotFound desc = could not find container \"6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1\": container with ID starting with 6dac7a9e747dcb350978776622d0d7dde7ce1aa43be10f914a51e3e88fcde1e1 not found: ID does not exist" Jul 14 01:26:42.755762 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.755726 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk"] Jul 14 01:26:42.758285 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.758263 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c626eb13-5776879c77-rc4gk"] Jul 14 01:26:42.808043 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:42.807978 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:44.666626 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:44.666584 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be183f4-7730-449f-9991-82bf254c9acc" path="/var/lib/kubelet/pods/5be183f4-7730-449f-9991-82bf254c9acc/volumes" Jul 14 01:26:46.361697 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:46.361663 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:52.027447 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:52.027411 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:52.084240 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:52.084194 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:56.547642 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:56.547604 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:56.924525 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:56.924494 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:57.024161 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.024127 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:57.085905 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.085876 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj"] Jul 14 01:26:57.086361 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.086344 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be183f4-7730-449f-9991-82bf254c9acc" containerName="maas-api" Jul 14 01:26:57.086418 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.086366 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be183f4-7730-449f-9991-82bf254c9acc" containerName="maas-api" Jul 14 01:26:57.086519 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.086506 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be183f4-7730-449f-9991-82bf254c9acc" containerName="maas-api" Jul 14 01:26:57.098632 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.098603 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.107052 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.107015 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj"] Jul 14 01:26:57.107273 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.107252 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4928854b-gw-openshift-default-dockercfg-bwsns\"" Jul 14 01:26:57.126221 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.126195 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:57.214174 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214078 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29s2b\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-kube-api-access-29s2b\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.214174 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-socket\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.214419 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214220 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-credential-socket\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.214419 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214302 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-certs\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.214419 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214332 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-envoy\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.214419 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214356 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-data\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.214419 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214383 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istiod-ca-cert\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.214621 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214481 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-podinfo\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.214621 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.214526 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-token\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.315838 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.315804 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29s2b\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-kube-api-access-29s2b\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316022 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.315844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-socket\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316022 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.315904 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-credential-socket\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316022 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.315984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-certs\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316022 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316010 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-envoy\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316236 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316033 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-data\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316236 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316060 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istiod-ca-cert\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316236 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316109 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-podinfo\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316236 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316132 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-token\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316536 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316271 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-socket\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316536 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316320 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-credential-socket\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316536 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316440 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-certs\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316731 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316676 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-data\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.316812 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.316795 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istiod-ca-cert\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.318784 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.318760 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-envoy\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.318936 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.318799 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-podinfo\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.324088 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.324059 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29s2b\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-kube-api-access-29s2b\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.324175 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.324115 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-token\") pod \"e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.420834 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.420808 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:57.562565 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.562540 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj"] Jul 14 01:26:57.563782 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:26:57.563756 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e846fad_4edb_48a5_b4d1_0e6a2584c5b0.slice/crio-6af5a7756594dcc0e7d18a990b181ef3d3ad4fbdf1eb036a3718db2f017bc4c7 WatchSource:0}: Error finding container 6af5a7756594dcc0e7d18a990b181ef3d3ad4fbdf1eb036a3718db2f017bc4c7: Status 404 returned error can't find the container with id 6af5a7756594dcc0e7d18a990b181ef3d3ad4fbdf1eb036a3718db2f017bc4c7 Jul 14 01:26:57.565908 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.565873 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:26:57.566023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.565967 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:26:57.566023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.566002 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:26:57.817978 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.817878 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" event={"ID":"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0","Type":"ContainerStarted","Data":"f7b12c26ba5e90fb6e1e0102b64050601cbbbf28b7f43d25203013b8111925d7"} Jul 14 01:26:57.817978 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.817943 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" event={"ID":"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0","Type":"ContainerStarted","Data":"6af5a7756594dcc0e7d18a990b181ef3d3ad4fbdf1eb036a3718db2f017bc4c7"} Jul 14 01:26:57.838010 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:57.837959 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" podStartSLOduration=0.837943748 podStartE2EDuration="837.943748ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:26:57.836569373 +0000 UTC m=+1665.707004563" watchObservedRunningTime="2026-07-14 01:26:57.837943748 +0000 UTC m=+1665.708378933" Jul 14 01:26:58.388793 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:58.388755 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:58.421620 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:58.421586 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:58.426753 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:58.426729 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:58.493983 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:58.493949 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:58.823382 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:58.823352 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:58.824324 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:58.824304 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:26:58.871775 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:58.871730 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:58.975571 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:58.975541 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:26:59.076307 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:26:59.076216 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:27:02.953563 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:02.953534 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:27:03.006062 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:03.006018 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:27:06.228691 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:06.228660 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:27:14.579342 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:14.578180 2570 patch_prober.go:28] interesting pod/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:49804->10.132.0.56:15021: read: connection reset by peer" start-of-body= Jul 14 01:27:14.579342 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:14.578244 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:49804->10.132.0.56:15021: read: connection reset by peer" Jul 14 01:27:14.914520 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:14.914410 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerID="f7b12c26ba5e90fb6e1e0102b64050601cbbbf28b7f43d25203013b8111925d7" exitCode=0 Jul 14 01:27:14.914520 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:14.914491 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" event={"ID":"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0","Type":"ContainerDied","Data":"f7b12c26ba5e90fb6e1e0102b64050601cbbbf28b7f43d25203013b8111925d7"} Jul 14 01:27:14.914897 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:14.914882 2570 scope.go:117] "RemoveContainer" containerID="f7b12c26ba5e90fb6e1e0102b64050601cbbbf28b7f43d25203013b8111925d7" Jul 14 01:27:14.915958 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:14.915908 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:27:14.916032 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:14.916019 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:27:14.916119 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:14.916098 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:27:15.923518 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:15.923479 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" event={"ID":"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0","Type":"ContainerStarted","Data":"1ba67cb5dcd307373b800496110f6c73bbe1b3129d3e019747882848e07e36f6"} Jul 14 01:27:16.421487 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:16.421455 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:27:16.421678 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:16.421657 2570 patch_prober.go:28] interesting pod/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 01:27:16.421728 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:16.421704 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 01:27:17.421355 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:17.421318 2570 patch_prober.go:28] interesting pod/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 01:27:17.421744 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:17.421374 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 01:27:18.421839 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:18.421801 2570 patch_prober.go:28] interesting pod/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 01:27:18.422249 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:18.421856 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 01:27:19.422034 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:19.421993 2570 patch_prober.go:28] interesting pod/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 14 01:27:19.422434 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:19.422058 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 14 01:27:20.425124 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:20.425092 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:27:20.425499 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:20.425475 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:27:20.426229 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:20.426212 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:27:47.842845 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:47.842809 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:27:51.160384 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:51.160350 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:27:51.210814 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:27:51.210783 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:03.033334 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:03.033294 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj"] Jul 14 01:28:03.033857 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:03.033552 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" containerID="cri-o://1ba67cb5dcd307373b800496110f6c73bbe1b3129d3e019747882848e07e36f6" gracePeriod=30 Jul 14 01:28:03.056340 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:03.056296 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:03.169946 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:03.169876 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:05.427970 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:05.427910 2570 patch_prober.go:28] interesting pod/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 01:28:05.428354 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:05.428009 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 01:28:08.210977 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.210939 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerID="1ba67cb5dcd307373b800496110f6c73bbe1b3129d3e019747882848e07e36f6" exitCode=0 Jul 14 01:28:08.211333 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.210955 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" event={"ID":"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0","Type":"ContainerDied","Data":"1ba67cb5dcd307373b800496110f6c73bbe1b3129d3e019747882848e07e36f6"} Jul 14 01:28:08.211333 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.211084 2570 scope.go:117] "RemoveContainer" containerID="f7b12c26ba5e90fb6e1e0102b64050601cbbbf28b7f43d25203013b8111925d7" Jul 14 01:28:08.296140 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.296077 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:28:08.373487 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373453 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-credential-socket\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373658 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373501 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-token\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373658 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373550 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-data\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373658 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373583 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istiod-ca-cert\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373658 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373626 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-podinfo\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373658 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373660 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29s2b\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-kube-api-access-29s2b\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373955 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373688 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-certs\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373955 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373719 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-envoy\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373955 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373743 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-socket\") pod \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\" (UID: \"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0\") " Jul 14 01:28:08.373955 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.373754 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:28:08.374158 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.374027 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-credential-socket\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.374158 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.374037 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:28:08.374263 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.374230 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:28:08.374411 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.374386 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:28:08.374560 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.374415 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:28:08.376162 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.376131 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-kube-api-access-29s2b" (OuterVolumeSpecName: "kube-api-access-29s2b") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "kube-api-access-29s2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:28:08.376274 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.376162 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 01:28:08.376274 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.376267 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:28:08.376568 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.376550 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" (UID: "2e846fad-4edb-48a5-b4d1-0e6a2584c5b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:28:08.474802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.474760 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-token\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.474802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.474798 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-data\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.475029 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.474828 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istiod-ca-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.475029 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.474838 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-podinfo\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.475029 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.474847 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29s2b\" (UniqueName: \"kubernetes.io/projected/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-kube-api-access-29s2b\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.475029 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.474856 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-certs\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.475029 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.474864 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-istio-envoy\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.475029 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.474871 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0-workload-socket\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:28:08.905574 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:08.905538 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:09.135684 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:09.135610 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:09.217134 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:09.217102 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" Jul 14 01:28:09.217586 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:09.217137 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj" event={"ID":"2e846fad-4edb-48a5-b4d1-0e6a2584c5b0","Type":"ContainerDied","Data":"6af5a7756594dcc0e7d18a990b181ef3d3ad4fbdf1eb036a3718db2f017bc4c7"} Jul 14 01:28:09.217586 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:09.217192 2570 scope.go:117] "RemoveContainer" containerID="1ba67cb5dcd307373b800496110f6c73bbe1b3129d3e019747882848e07e36f6" Jul 14 01:28:09.234864 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:09.234833 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj"] Jul 14 01:28:09.238701 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:09.238673 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4928854b-gw-openshift-default-7bbbd5594c-6h4qj"] Jul 14 01:28:09.495095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:09.495065 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:10.666276 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:10.666244 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" path="/var/lib/kubelet/pods/2e846fad-4edb-48a5-b4d1-0e6a2584c5b0/volumes" Jul 14 01:28:14.550251 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:14.550198 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:14.650662 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:14.650627 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:14.786213 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:14.786178 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:14.886260 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:14.886176 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:15.870361 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:15.870291 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:16.044810 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:16.044774 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:16.199859 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:16.199825 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:16.291482 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:16.291436 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:16.512701 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:16.512601 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:16.612809 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:16.612778 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:28:17.994413 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:28:17.994384 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:31.478249 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:31.478210 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:36.215190 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:36.215155 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:41.489500 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:41.489453 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:41.591513 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:41.591476 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:42.075891 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:42.075849 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:42.175858 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:42.175825 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:47.281129 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:47.281093 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:47.588012 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:47.587973 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:48.694187 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:48.694148 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:48.775716 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:48.775662 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:48.843538 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:48.843503 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:49.244834 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:49.244801 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:49.350641 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:49.350609 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:49.448233 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:49.448200 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:53.741004 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:53.740972 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:53.840984 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:53.840939 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:29:57.185486 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:29:57.185443 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:30:53.652185 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:30:53.652134 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:30:58.218686 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:30:58.218650 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:04.061997 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:04.061963 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:04.162373 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:04.162336 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:08.401841 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:08.401806 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:08.995261 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:08.995214 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:09.092529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:09.092497 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:09.195360 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:09.195327 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:10.627766 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:10.627733 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:14.921218 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:14.921185 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:16.624631 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:16.624591 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:16.681809 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:16.681774 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:16.756568 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:16.756536 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:16.856401 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:16.856367 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:16.958353 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:16.958326 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:17.336548 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:17.336465 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:43.291389 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:43.291353 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:48.922287 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:48.922251 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:49.027958 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:49.027907 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:31:49.123085 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:31:49.123049 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:04.972638 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:04.972563 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:10.753391 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:10.753352 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:12.213020 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:12.212982 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:21.470862 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:21.470829 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:22.244034 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:22.244002 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:27.915495 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:27.915464 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:28.021620 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:28.021586 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:28.118065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:28.118028 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:28.218248 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:28.218160 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:28.979626 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:28.979593 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:29.099666 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:29.099632 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:29.187159 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:29.187127 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:30.748789 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:30.748753 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:36.482254 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:36.482213 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:36.545729 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:36.545694 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:37.148554 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:37.148521 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:42.755494 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:42.755460 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:42.808382 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:42.808344 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:42.989212 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:42.989178 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:43.278734 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:43.278679 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:43.671397 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:43.671365 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:46.346178 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:46.346143 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:46.424505 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:46.424468 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:46.491326 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:46.491291 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:46.588883 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:46.588852 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:46.888484 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:46.888449 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:46.945395 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:46.945363 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:50.838319 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:50.838273 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:51.486532 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:51.486494 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:51.579603 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:51.579570 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:51.916038 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:51.916013 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:57.785871 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:57.785835 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:32:57.887105 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:32:57.887069 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:08.518280 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:08.518248 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:13.207329 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:13.207291 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:19.053232 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:19.053203 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:19.117304 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:19.117272 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:23.879367 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:23.879318 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:24.116551 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:24.116512 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:24.262277 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:24.262243 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:24.368708 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:24.368675 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:24.501394 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:24.501360 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:30.096656 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:30.096620 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:30.146999 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:30.146959 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:30.215549 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:30.215515 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:30.314421 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:30.314385 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:30.445186 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:30.445159 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:36.070307 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:36.070231 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:36.134072 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:36.134036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:42.869833 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:42.869794 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:43.171537 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:43.171504 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:43.717279 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:43.717241 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:45.663740 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:45.663702 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:45.749260 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:45.749224 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:45.892693 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:45.892652 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:45.995209 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:45.995179 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:46.216652 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:46.216621 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:46.317639 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:46.317541 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:33:50.193023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:33:50.192986 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:19.961836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:19.961801 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:38.511887 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:38.511850 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:38.619985 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:38.619949 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:42.290324 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:42.290282 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:42.390850 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:42.390813 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:49.528671 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:49.528638 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:49.627312 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:49.627264 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:49.790981 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:49.790882 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:54.054774 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:54.054734 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:34:59.135213 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:34:59.135168 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:35.890963 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:35.890899 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:36.259435 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:36.259398 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:41.764125 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:41.764090 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:41.864660 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:41.864626 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:46.394993 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:46.394962 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:46.625010 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:46.624976 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:47.762669 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:47.762634 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:47.869895 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:47.869846 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:47.961652 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:47.961603 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:48.668405 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:48.668358 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:48.768818 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:48.768770 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:48.868471 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:48.868436 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:50.307811 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:50.307762 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:56.092722 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:56.092690 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:56.162038 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:56.162012 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:35:56.744949 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:35:56.744885 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:02.471435 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:02.471393 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:02.534945 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:02.534873 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:02.621883 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:02.621833 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:02.787295 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:02.787205 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:06.964457 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:06.964408 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:13.160067 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:13.160015 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:13.492829 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:13.492794 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:34.455310 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:34.455220 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:40.109177 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:40.109130 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:40.211062 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:40.211029 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:40.481877 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:40.481842 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:40.813103 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:40.813010 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:41.043663 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:41.043611 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:43.624660 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:43.624609 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:43.724007 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:43.723973 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:43.849046 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:43.849010 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:44.274047 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:44.274007 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:44.390211 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:44.390176 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:44.491206 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:44.491171 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:48.120316 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.120271 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:48.439474 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.439439 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:48.712941 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.712832 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4"] Jul 14 01:36:48.713225 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.713211 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" Jul 14 01:36:48.713225 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.713226 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" Jul 14 01:36:48.713345 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.713244 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" Jul 14 01:36:48.713345 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.713249 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" Jul 14 01:36:48.713345 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.713309 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" Jul 14 01:36:48.713345 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.713318 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e846fad-4edb-48a5-b4d1-0e6a2584c5b0" containerName="istio-proxy" Jul 14 01:36:48.716456 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.716436 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.718726 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.718705 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d5004e-openshift-default-dockercfg-s78d2\"" Jul 14 01:36:48.727682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.727658 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4"] Jul 14 01:36:48.740087 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.740062 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:48.791600 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791569 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-data\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.791781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791607 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46fgm\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-kube-api-access-46fgm\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.791781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-envoy\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.791781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791669 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c575ad97-b981-4454-945b-43d3b7fcfd53-istiod-ca-cert\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.791781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791706 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-socket\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.791781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791725 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-certs\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.791781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791748 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-credential-socket\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.791781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791767 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-podinfo\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.791781 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.791782 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-token\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892435 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892396 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-socket\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892435 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892434 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-certs\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892456 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-credential-socket\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892476 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-podinfo\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892502 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-token\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892591 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-data\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892632 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46fgm\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-kube-api-access-46fgm\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892670 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-envoy\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.892880 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.892693 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c575ad97-b981-4454-945b-43d3b7fcfd53-istiod-ca-cert\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.893080 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.893056 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-socket\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.893166 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.893099 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-certs\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.893212 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.893165 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-credential-socket\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.893212 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.893201 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-data\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.893498 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.893482 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c575ad97-b981-4454-945b-43d3b7fcfd53-istiod-ca-cert\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.895082 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.895060 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-envoy\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.895388 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.895367 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-podinfo\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.900075 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.900050 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-token\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:48.900261 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:48.900243 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46fgm\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-kube-api-access-46fgm\") pod \"e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:49.026534 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.026439 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:49.161394 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.161362 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4"] Jul 14 01:36:49.162976 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:36:49.162947 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc575ad97_b981_4454_945b_43d3b7fcfd53.slice/crio-c5cff533ba3d5e8322e62653eec9293a6e4a30e05da7e4a467186658148971cf WatchSource:0}: Error finding container c5cff533ba3d5e8322e62653eec9293a6e4a30e05da7e4a467186658148971cf: Status 404 returned error can't find the container with id c5cff533ba3d5e8322e62653eec9293a6e4a30e05da7e4a467186658148971cf Jul 14 01:36:49.165148 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.165111 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:36:49.165268 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.165195 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:36:49.165268 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.165237 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:36:49.309323 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.309232 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:49.872751 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.872712 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" event={"ID":"c575ad97-b981-4454-945b-43d3b7fcfd53","Type":"ContainerStarted","Data":"acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25"} Jul 14 01:36:49.872941 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.872806 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" event={"ID":"c575ad97-b981-4454-945b-43d3b7fcfd53","Type":"ContainerStarted","Data":"c5cff533ba3d5e8322e62653eec9293a6e4a30e05da7e4a467186658148971cf"} Jul 14 01:36:49.895785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:49.895725 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podStartSLOduration=1.895706552 podStartE2EDuration="1.895706552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:36:49.892753125 +0000 UTC m=+2257.763188315" watchObservedRunningTime="2026-07-14 01:36:49.895706552 +0000 UTC m=+2257.766141743" Jul 14 01:36:50.027538 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:50.027504 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:50.032700 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:50.032673 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:50.878056 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:50.878027 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:50.879095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:50.879073 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:36:51.788385 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:51.788356 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:51.862735 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:51.862698 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:51.924428 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:51.924390 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:52.132955 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:52.132852 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:52.233181 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:52.233124 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:52.333952 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:52.333874 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:52.434320 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:52.434292 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:36:56.303039 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:36:56.303003 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:03.780252 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:03.780216 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:05.350788 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:05.350756 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:05.449059 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:05.449023 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:06.920117 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:06.920064 2570 patch_prober.go:28] interesting pod/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 14 01:37:06.920636 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:06.920136 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 14 01:37:07.969555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:07.969520 2570 generic.go:356] "Generic (PLEG): container finished" podID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerID="acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25" exitCode=0 Jul 14 01:37:07.970070 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:07.969591 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" event={"ID":"c575ad97-b981-4454-945b-43d3b7fcfd53","Type":"ContainerDied","Data":"acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25"} Jul 14 01:37:07.970070 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:07.970010 2570 scope.go:117] "RemoveContainer" containerID="acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25" Jul 14 01:37:07.971052 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:07.971024 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:37:07.971118 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:07.971092 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:37:07.971154 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:07.971122 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:37:08.977177 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:08.977139 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" event={"ID":"c575ad97-b981-4454-945b-43d3b7fcfd53","Type":"ContainerStarted","Data":"d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480"} Jul 14 01:37:09.027485 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:09.027449 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:37:09.027677 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:09.027654 2570 patch_prober.go:28] interesting pod/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 01:37:09.027725 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:09.027701 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 01:37:10.026925 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:10.026888 2570 patch_prober.go:28] interesting pod/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 01:37:10.027327 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:10.026979 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 01:37:11.026906 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:11.026869 2570 patch_prober.go:28] interesting pod/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 01:37:11.027114 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:11.026967 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 01:37:12.027777 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:12.027740 2570 patch_prober.go:28] interesting pod/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 01:37:12.028264 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:12.027820 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 01:37:12.532012 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:12.531980 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:13.027329 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:13.027286 2570 patch_prober.go:28] interesting pod/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 14 01:37:13.027508 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:13.027363 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 14 01:37:13.956055 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:13.956016 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:14.030756 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:14.030723 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:37:14.031013 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:14.030991 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:37:14.031801 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:14.031784 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:37:14.053786 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:14.053755 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:30.561720 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:30.561686 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:44.245799 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:44.245744 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:49.592412 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:49.592375 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:50.477698 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:50.477669 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:51.206290 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:51.206256 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:37:51.307125 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:37:51.307088 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:00.975073 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:00.975036 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:05.666523 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:05.666432 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:11.347164 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:11.347122 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:11.447979 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:11.447941 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:16.340904 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:16.340863 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:16.573004 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:16.572972 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:17.256335 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:17.256300 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:17.356751 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:17.356719 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:27.083451 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:27.083414 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:27.267164 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:27.267130 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:31.769361 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:31.769320 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:37.440080 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:37.440048 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:37.501049 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:37.501018 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:42.404560 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:42.404523 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4"] Jul 14 01:38:42.405109 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:42.404778 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" containerID="cri-o://d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480" gracePeriod=30 Jul 14 01:38:42.418680 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:42.418647 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:42.642763 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:42.642732 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:42.986761 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:42.986731 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:43.301209 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:43.301119 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:43.605967 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:43.605865 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:44.034262 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:44.034219 2570 patch_prober.go:28] interesting pod/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 01:38:44.034432 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:44.034286 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 01:38:46.283910 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:46.283863 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:46.379073 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:46.379027 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:46.449010 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:46.448977 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:46.838065 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:46.838026 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:47.046298 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.046267 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:47.150196 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.150103 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:47.679018 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.678994 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:38:47.793333 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793292 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-certs\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.793529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793355 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-data\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.793529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793388 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-token\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.793529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793449 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-podinfo\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.793529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793477 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46fgm\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-kube-api-access-46fgm\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.793529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793523 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c575ad97-b981-4454-945b-43d3b7fcfd53-istiod-ca-cert\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.793803 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793546 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-socket\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.793803 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793586 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:38:47.793803 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793613 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-envoy\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.793803 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793651 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-credential-socket\") pod \"c575ad97-b981-4454-945b-43d3b7fcfd53\" (UID: \"c575ad97-b981-4454-945b-43d3b7fcfd53\") " Jul 14 01:38:47.794040 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793820 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:38:47.794040 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793964 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-socket\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:47.794040 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.793981 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-workload-certs\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:47.794202 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.794112 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:38:47.794386 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.794253 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c575ad97-b981-4454-945b-43d3b7fcfd53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:38:47.795317 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.795286 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-data" (OuterVolumeSpecName: "istio-data") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:38:47.796274 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.796203 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-token" (OuterVolumeSpecName: "istio-token") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:38:47.796274 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.796230 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-kube-api-access-46fgm" (OuterVolumeSpecName: "kube-api-access-46fgm") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "kube-api-access-46fgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:38:47.796274 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.796244 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:38:47.796437 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.796286 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c575ad97-b981-4454-945b-43d3b7fcfd53" (UID: "c575ad97-b981-4454-945b-43d3b7fcfd53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 01:38:47.895444 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.895405 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-envoy\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:47.895444 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.895436 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-credential-socket\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:47.895444 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.895447 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-data\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:47.895444 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.895455 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-token\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:47.895717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.895462 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c575ad97-b981-4454-945b-43d3b7fcfd53-istio-podinfo\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:47.895717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.895471 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46fgm\" (UniqueName: \"kubernetes.io/projected/c575ad97-b981-4454-945b-43d3b7fcfd53-kube-api-access-46fgm\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:47.895717 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:47.895479 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c575ad97-b981-4454-945b-43d3b7fcfd53-istiod-ca-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:38:48.511328 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.511292 2570 generic.go:356] "Generic (PLEG): container finished" podID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerID="d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480" exitCode=0 Jul 14 01:38:48.511547 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.511344 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" Jul 14 01:38:48.511547 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.511385 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" event={"ID":"c575ad97-b981-4454-945b-43d3b7fcfd53","Type":"ContainerDied","Data":"d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480"} Jul 14 01:38:48.511547 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.511447 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4" event={"ID":"c575ad97-b981-4454-945b-43d3b7fcfd53","Type":"ContainerDied","Data":"c5cff533ba3d5e8322e62653eec9293a6e4a30e05da7e4a467186658148971cf"} Jul 14 01:38:48.511547 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.511478 2570 scope.go:117] "RemoveContainer" containerID="d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480" Jul 14 01:38:48.521227 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.521210 2570 scope.go:117] "RemoveContainer" containerID="acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25" Jul 14 01:38:48.529763 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.529608 2570 scope.go:117] "RemoveContainer" containerID="d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480" Jul 14 01:38:48.529973 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:38:48.529942 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480\": container with ID starting with d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480 not found: ID does not exist" containerID="d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480" Jul 14 01:38:48.530082 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.529984 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480"} err="failed to get container status \"d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480\": rpc error: code = NotFound desc = could not find container \"d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480\": container with ID starting with d6a5a53b79cf70c7be5e6835eab90973d9aa3ddd702cff0c00ba3320aff98480 not found: ID does not exist" Jul 14 01:38:48.530082 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.530007 2570 scope.go:117] "RemoveContainer" containerID="acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25" Jul 14 01:38:48.530337 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:38:48.530313 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25\": container with ID starting with acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25 not found: ID does not exist" containerID="acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25" Jul 14 01:38:48.530410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.530346 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25"} err="failed to get container status \"acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25\": rpc error: code = NotFound desc = could not find container \"acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25\": container with ID starting with acb027f3190ffca28eb178b670b6c403f95d67429f26d7cc263e3f345012ac25 not found: ID does not exist" Jul 14 01:38:48.533060 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.533043 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4"] Jul 14 01:38:48.538206 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.538179 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d5004e-openshift-default-58666d87ff-dmqq4"] Jul 14 01:38:48.666399 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:48.666365 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" path="/var/lib/kubelet/pods/c575ad97-b981-4454-945b-43d3b7fcfd53/volumes" Jul 14 01:38:50.790179 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:50.790148 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:51.238284 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.238236 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:51.503118 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.503031 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw"] Jul 14 01:38:51.503601 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.503578 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" Jul 14 01:38:51.503601 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.503598 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" Jul 14 01:38:51.503825 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.503622 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" Jul 14 01:38:51.503825 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.503628 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" Jul 14 01:38:51.503825 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.503703 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" Jul 14 01:38:51.503825 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.503714 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c575ad97-b981-4454-945b-43d3b7fcfd53" containerName="istio-proxy" Jul 14 01:38:51.508144 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.508121 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.510429 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.510406 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-99bb7c-openshift-default-dockercfg-rvhbx\"" Jul 14 01:38:51.518013 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.517985 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw"] Jul 14 01:38:51.537252 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.537222 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:51.614747 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.614708 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:51.629972 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.629949 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-podinfo\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.630073 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.629986 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-token\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.630073 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.630057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-credential-socket\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.630163 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.630100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-data\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.630163 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.630129 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-socket\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.630163 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.630152 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65553e61-e78c-4b2e-a832-da146b42d6f6-istiod-ca-cert\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.630286 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.630190 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p58bj\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-kube-api-access-p58bj\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.630286 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.630210 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-envoy\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.630379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.630289 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-certs\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731101 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-podinfo\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731143 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731141 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-token\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-credential-socket\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731207 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-data\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731232 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-socket\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731247 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65553e61-e78c-4b2e-a832-da146b42d6f6-istiod-ca-cert\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731286 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p58bj\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-kube-api-access-p58bj\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731312 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-envoy\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731410 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731360 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-certs\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731835 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731734 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-data\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731835 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731746 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-certs\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.731835 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731752 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-socket\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.732023 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.731898 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-credential-socket\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.732247 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.732083 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65553e61-e78c-4b2e-a832-da146b42d6f6-istiod-ca-cert\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.733762 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.733738 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-envoy\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.734109 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.734086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-podinfo\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.743106 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.743081 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-token\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.743282 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.743262 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p58bj\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-kube-api-access-p58bj\") pod \"e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.819987 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.819876 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:51.960875 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.960850 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw"] Jul 14 01:38:51.962558 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:38:51.962519 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65553e61_e78c_4b2e_a832_da146b42d6f6.slice/crio-3e7a93e438e69bfd3a6333005f5c1222671cbdbe43d134da05d9b5feaade4a35 WatchSource:0}: Error finding container 3e7a93e438e69bfd3a6333005f5c1222671cbdbe43d134da05d9b5feaade4a35: Status 404 returned error can't find the container with id 3e7a93e438e69bfd3a6333005f5c1222671cbdbe43d134da05d9b5feaade4a35 Jul 14 01:38:51.967561 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.967523 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:38:51.967672 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.967609 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:38:51.967672 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:51.967656 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:38:52.533886 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:52.533849 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" event={"ID":"65553e61-e78c-4b2e-a832-da146b42d6f6","Type":"ContainerStarted","Data":"253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea"} Jul 14 01:38:52.534094 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:52.533901 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" event={"ID":"65553e61-e78c-4b2e-a832-da146b42d6f6","Type":"ContainerStarted","Data":"3e7a93e438e69bfd3a6333005f5c1222671cbdbe43d134da05d9b5feaade4a35"} Jul 14 01:38:52.556841 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:52.556787 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" podStartSLOduration=1.556771283 podStartE2EDuration="1.556771283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:38:52.55336807 +0000 UTC m=+2380.423803261" watchObservedRunningTime="2026-07-14 01:38:52.556771283 +0000 UTC m=+2380.427206473" Jul 14 01:38:52.820682 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:52.820591 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:53.825700 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:53.825665 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:54.459547 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:54.459510 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:54.544618 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:54.544589 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:54.545590 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:54.545567 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:38:54.606859 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:54.606829 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:54.721000 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:54.720897 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:55.146793 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:55.146714 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:55.247627 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:55.247593 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:55.307950 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:55.307900 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:38:59.011278 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:38:59.011244 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:06.627790 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:06.627700 2570 generic.go:356] "Generic (PLEG): container finished" podID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerID="253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea" exitCode=0 Jul 14 01:39:06.627790 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:06.627767 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" event={"ID":"65553e61-e78c-4b2e-a832-da146b42d6f6","Type":"ContainerDied","Data":"253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea"} Jul 14 01:39:06.628255 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:06.628192 2570 scope.go:117] "RemoveContainer" containerID="253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea" Jul 14 01:39:06.629178 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:06.629148 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:39:06.629283 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:06.629213 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:39:06.629283 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:06.629243 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:39:07.634629 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:07.634600 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" event={"ID":"65553e61-e78c-4b2e-a832-da146b42d6f6","Type":"ContainerStarted","Data":"37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01"} Jul 14 01:39:07.704625 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:07.704581 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:07.803989 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:07.803945 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:07.820961 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:07.820893 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:39:07.822262 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:07.822234 2570 patch_prober.go:28] interesting pod/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 14 01:39:07.822392 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:07.822300 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 14 01:39:08.820707 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:08.820668 2570 patch_prober.go:28] interesting pod/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 14 01:39:08.821132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:08.820724 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 14 01:39:09.544722 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:09.544672 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:39:09.820975 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:09.820857 2570 patch_prober.go:28] interesting pod/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 14 01:39:09.820975 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:09.820947 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 14 01:39:10.820711 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:10.820674 2570 patch_prober.go:28] interesting pod/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 14 01:39:10.820945 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:10.820738 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 14 01:39:11.824275 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:11.824240 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:39:11.825259 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:11.825240 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:39:15.863729 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:15.863686 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:15.964281 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:15.964245 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:17.744298 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:17.744266 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:17.845354 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:17.845324 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:17.997374 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:17.997288 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:22.180529 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:22.180489 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:28.007701 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:28.007663 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:28.069664 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:28.069629 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:32.851545 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:32.851513 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:33.095447 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:33.095415 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:33.785698 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:33.785618 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:33.885807 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:33.885777 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:43.084179 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:43.084136 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:43.184795 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:43.184759 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:43.336933 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:43.336830 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:48.297839 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:48.297801 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:53.831122 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:53.831089 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:53.931397 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:53.931363 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:58.975443 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:58.975403 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw"] Jul 14 01:39:58.975956 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:58.975708 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" containerID="cri-o://37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01" gracePeriod=30 Jul 14 01:39:58.989197 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:58.989155 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:59.219935 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:59.219894 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:59.561778 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:59.561746 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:59.867865 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:59.867785 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:39:59.978777 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:39:59.978740 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:02.748569 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:02.748536 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:02.824074 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:02.824037 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:02.928096 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:02.928061 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:03.201394 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:03.201359 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:03.382566 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:03.382520 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:03.482904 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:03.482771 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:04.258728 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.258703 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:40:04.395624 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395592 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-token\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.395836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395652 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-credential-socket\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.395836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395683 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-socket\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.395836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395738 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-podinfo\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.395836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395780 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65553e61-e78c-4b2e-a832-da146b42d6f6-istiod-ca-cert\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.395836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395807 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-envoy\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.396127 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395871 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p58bj\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-kube-api-access-p58bj\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.396127 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395899 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-data\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.396127 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395947 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-certs\") pod \"65553e61-e78c-4b2e-a832-da146b42d6f6\" (UID: \"65553e61-e78c-4b2e-a832-da146b42d6f6\") " Jul 14 01:40:04.396127 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.395978 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:40:04.396127 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.396016 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:40:04.396471 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.396245 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-credential-socket\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.396471 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.396264 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-socket\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.396471 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.396278 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65553e61-e78c-4b2e-a832-da146b42d6f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:40:04.396471 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.396361 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:40:04.397115 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.397085 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:40:04.398209 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.398185 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-kube-api-access-p58bj" (OuterVolumeSpecName: "kube-api-access-p58bj") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "kube-api-access-p58bj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:40:04.398680 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.398654 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:40:04.398680 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.398658 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 01:40:04.398898 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.398881 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "65553e61-e78c-4b2e-a832-da146b42d6f6" (UID: "65553e61-e78c-4b2e-a832-da146b42d6f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:40:04.497379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.497289 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-podinfo\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.497379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.497322 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65553e61-e78c-4b2e-a832-da146b42d6f6-istiod-ca-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.497379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.497331 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-envoy\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.497379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.497339 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p58bj\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-kube-api-access-p58bj\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.497379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.497349 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-data\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.497379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.497357 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65553e61-e78c-4b2e-a832-da146b42d6f6-workload-certs\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.497379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.497364 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65553e61-e78c-4b2e-a832-da146b42d6f6-istio-token\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:40:04.925268 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.925233 2570 generic.go:356] "Generic (PLEG): container finished" podID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerID="37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01" exitCode=0 Jul 14 01:40:04.925429 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.925286 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" Jul 14 01:40:04.925429 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.925316 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" event={"ID":"65553e61-e78c-4b2e-a832-da146b42d6f6","Type":"ContainerDied","Data":"37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01"} Jul 14 01:40:04.925429 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.925363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw" event={"ID":"65553e61-e78c-4b2e-a832-da146b42d6f6","Type":"ContainerDied","Data":"3e7a93e438e69bfd3a6333005f5c1222671cbdbe43d134da05d9b5feaade4a35"} Jul 14 01:40:04.925429 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.925387 2570 scope.go:117] "RemoveContainer" containerID="37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01" Jul 14 01:40:04.934379 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.934356 2570 scope.go:117] "RemoveContainer" containerID="253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea" Jul 14 01:40:04.942900 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.942878 2570 scope.go:117] "RemoveContainer" containerID="37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01" Jul 14 01:40:04.943197 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:40:04.943178 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01\": container with ID starting with 37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01 not found: ID does not exist" containerID="37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01" Jul 14 01:40:04.943251 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.943206 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01"} err="failed to get container status \"37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01\": rpc error: code = NotFound desc = could not find container \"37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01\": container with ID starting with 37ab5d35355e3e46a490ec6e59bfcf57ee120225f9864bb024b2d9d32ad49d01 not found: ID does not exist" Jul 14 01:40:04.943251 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.943225 2570 scope.go:117] "RemoveContainer" containerID="253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea" Jul 14 01:40:04.943505 ip-10-0-131-57 kubenswrapper[2570]: E0714 01:40:04.943477 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea\": container with ID starting with 253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea not found: ID does not exist" containerID="253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea" Jul 14 01:40:04.943547 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.943517 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea"} err="failed to get container status \"253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea\": rpc error: code = NotFound desc = could not find container \"253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea\": container with ID starting with 253e53400c237a024f721e9fb2024d5c275158a491422c23ede5a09f6961daea not found: ID does not exist" Jul 14 01:40:04.944188 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.944172 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw"] Jul 14 01:40:04.947795 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:04.947772 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-99bb7c-openshift-default-86787d4b85-mkqnw"] Jul 14 01:40:06.669938 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:06.667500 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" path="/var/lib/kubelet/pods/65553e61-e78c-4b2e-a832-da146b42d6f6/volumes" Jul 14 01:40:07.267811 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.267776 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:07.604761 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.604671 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:07.890147 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.890069 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc"] Jul 14 01:40:07.890650 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.890628 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" Jul 14 01:40:07.890650 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.890652 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" Jul 14 01:40:07.890763 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.890661 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" Jul 14 01:40:07.890763 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.890666 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" Jul 14 01:40:07.890763 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.890739 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" Jul 14 01:40:07.890763 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.890747 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="65553e61-e78c-4b2e-a832-da146b42d6f6" containerName="istio-proxy" Jul 14 01:40:07.895136 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.895110 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:07.897560 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.897540 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a21fee-openshift-default-dockercfg-qwbm7\"" Jul 14 01:40:07.906555 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.906523 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc"] Jul 14 01:40:07.917374 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:07.917347 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:08.033073 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033035 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-certs\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.033254 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3bae16f-721e-4987-89b0-a134218048bd-istio-podinfo\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.033254 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033124 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-credential-socket\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.033254 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033167 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3bae16f-721e-4987-89b0-a134218048bd-istiod-ca-cert\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.033254 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033188 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-istio-token\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.033404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033262 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-envoy\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.033404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033301 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-data\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.033404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033323 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjdnw\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-kube-api-access-kjdnw\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.033404 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.033349 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-socket\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134392 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134352 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3bae16f-721e-4987-89b0-a134218048bd-istiod-ca-cert\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134392 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134399 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-istio-token\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134650 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134441 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-envoy\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134650 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134479 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-data\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134650 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjdnw\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-kube-api-access-kjdnw\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134650 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134528 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-socket\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134650 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-certs\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134869 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134633 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3bae16f-721e-4987-89b0-a134218048bd-istio-podinfo\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.134869 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-credential-socket\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.135008 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134875 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-data\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.135008 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.134987 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-socket\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.135126 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.135058 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-credential-socket\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.135126 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.135105 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-certs\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.135231 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.135156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3bae16f-721e-4987-89b0-a134218048bd-istiod-ca-cert\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.137161 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.137141 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-envoy\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.137263 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.137246 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3bae16f-721e-4987-89b0-a134218048bd-istio-podinfo\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.152184 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.152125 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-istio-token\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.152552 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.152531 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjdnw\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-kube-api-access-kjdnw\") pod \"e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.170715 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.170686 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:08.207158 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.207122 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:08.348956 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.348926 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc"] Jul 14 01:40:08.350408 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:40:08.350389 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bae16f_721e_4987_89b0_a134218048bd.slice/crio-9db1423d27205360b9976246b4dab8252990a240fa9cb8d3c6162d15d9b038c7 WatchSource:0}: Error finding container 9db1423d27205360b9976246b4dab8252990a240fa9cb8d3c6162d15d9b038c7: Status 404 returned error can't find the container with id 9db1423d27205360b9976246b4dab8252990a240fa9cb8d3c6162d15d9b038c7 Jul 14 01:40:08.352473 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.352439 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:40:08.352552 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.352502 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:40:08.352552 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.352532 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:40:08.948188 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.948149 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" event={"ID":"a3bae16f-721e-4987-89b0-a134218048bd","Type":"ContainerStarted","Data":"f2a27046aa6bb711fb2107cb4550eef8ae2cc68075373f0db882bfa788195de2"} Jul 14 01:40:08.948619 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.948206 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" event={"ID":"a3bae16f-721e-4987-89b0-a134218048bd","Type":"ContainerStarted","Data":"9db1423d27205360b9976246b4dab8252990a240fa9cb8d3c6162d15d9b038c7"} Jul 14 01:40:08.969601 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:08.969550 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" podStartSLOduration=1.969534233 podStartE2EDuration="1.969534233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 01:40:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:40:08.968634319 +0000 UTC m=+2456.839069509" watchObservedRunningTime="2026-07-14 01:40:08.969534233 +0000 UTC m=+2456.839969421" Jul 14 01:40:09.207756 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:09.207668 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:09.212857 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:09.212829 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:09.953234 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:09.953199 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:09.954342 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:09.954319 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:10.956831 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:10.956795 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:11.053940 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:11.053872 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:11.154042 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:11.154009 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:11.454943 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:11.454889 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:11.555118 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:11.555082 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:15.399122 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:15.399083 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:23.032743 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:23.032708 2570 generic.go:356] "Generic (PLEG): container finished" podID="a3bae16f-721e-4987-89b0-a134218048bd" containerID="f2a27046aa6bb711fb2107cb4550eef8ae2cc68075373f0db882bfa788195de2" exitCode=0 Jul 14 01:40:23.033166 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:23.032781 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" event={"ID":"a3bae16f-721e-4987-89b0-a134218048bd","Type":"ContainerDied","Data":"f2a27046aa6bb711fb2107cb4550eef8ae2cc68075373f0db882bfa788195de2"} Jul 14 01:40:23.033221 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:23.033204 2570 scope.go:117] "RemoveContainer" containerID="f2a27046aa6bb711fb2107cb4550eef8ae2cc68075373f0db882bfa788195de2" Jul 14 01:40:23.034269 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:23.034244 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:40:23.034327 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:23.034308 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:40:23.034361 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:23.034342 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jul 14 01:40:24.039475 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:24.039435 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" event={"ID":"a3bae16f-721e-4987-89b0-a134218048bd","Type":"ContainerStarted","Data":"2c1decc7aeb676e71c995d3b6074878654333d1de9b4923517759de03a5764b5"} Jul 14 01:40:24.207780 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:24.207736 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:24.208801 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:24.208772 2570 patch_prober.go:28] interesting pod/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 14 01:40:24.208951 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:24.208834 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 14 01:40:24.953180 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:24.953143 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:25.041641 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:25.041595 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:25.142457 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:25.142423 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:25.208115 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:25.208023 2570 patch_prober.go:28] interesting pod/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 14 01:40:25.208115 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:25.208090 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 14 01:40:26.208369 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:26.208328 2570 patch_prober.go:28] interesting pod/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 14 01:40:26.208777 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:26.208386 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 14 01:40:27.207698 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:27.207653 2570 patch_prober.go:28] interesting pod/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 14 01:40:27.207892 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:27.207735 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 14 01:40:27.494184 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:27.494088 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:28.211624 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:28.211594 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:28.212706 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:28.212680 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:40:32.162347 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:32.162309 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:40:32.264174 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:40:32.264140 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:41:14.860655 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:41:14.860622 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:43:11.339243 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:43:11.339207 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:43:12.793486 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:43:12.793446 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:43:18.663474 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:43:18.663441 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:43:31.532646 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:43:31.532605 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:43:34.089329 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:43:34.089290 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:43:50.223768 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:43:50.223731 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:44:41.709112 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:44:41.709073 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:44:42.535933 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:44:42.535886 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:44:43.779834 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:44:43.779795 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:44:43.881041 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:44:43.880996 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:44:54.359332 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:44:54.359298 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:45:16.857895 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:45:16.857857 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:45:25.730170 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:45:25.730135 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:45:25.834166 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:45:25.834133 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:45:33.131384 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:45:33.131343 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:45:33.234836 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:45:33.234803 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:06.857094 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:06.857022 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:07.631314 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:07.631283 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:26.548090 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:26.548048 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:26.649213 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:26.649180 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:31.501966 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:31.501934 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:31.602897 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:31.602862 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:36.396967 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:36.396907 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:41.085998 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:41.085963 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:46.851790 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:46.851753 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:46.908695 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:46.908658 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:51.816298 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:51.816262 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:52.059612 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:52.059580 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:52.663891 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:52.663859 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:46:52.765806 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:46:52.765774 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:02.724090 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:02.724050 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:07.273316 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:07.273241 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:13.122797 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:13.122765 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:13.183655 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:13.183622 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:17.992572 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:17.992535 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc"] Jul 14 01:47:17.992989 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:17.992805 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" containerID="cri-o://2c1decc7aeb676e71c995d3b6074878654333d1de9b4923517759de03a5764b5" gracePeriod=30 Jul 14 01:47:18.006054 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:18.006021 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:18.271077 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:18.270989 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:18.751932 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:18.751877 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-579bd69b44-2pvn2_8e997440-f92a-4e59-9425-6ae163f4e5bc/authorino/0.log" Jul 14 01:47:23.203493 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.203454 2570 generic.go:356] "Generic (PLEG): container finished" podID="a3bae16f-721e-4987-89b0-a134218048bd" containerID="2c1decc7aeb676e71c995d3b6074878654333d1de9b4923517759de03a5764b5" exitCode=0 Jul 14 01:47:23.203953 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.203529 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" event={"ID":"a3bae16f-721e-4987-89b0-a134218048bd","Type":"ContainerDied","Data":"2c1decc7aeb676e71c995d3b6074878654333d1de9b4923517759de03a5764b5"} Jul 14 01:47:23.203953 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.203613 2570 scope.go:117] "RemoveContainer" containerID="f2a27046aa6bb711fb2107cb4550eef8ae2cc68075373f0db882bfa788195de2" Jul 14 01:47:23.254633 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.254564 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:47:23.327886 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.327854 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-envoy\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.327886 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.327889 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-credential-socket\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.328142 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.327943 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-istio-token\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.328142 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.327965 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-socket\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.328142 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328003 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3bae16f-721e-4987-89b0-a134218048bd-istio-podinfo\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.328142 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328041 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3bae16f-721e-4987-89b0-a134218048bd-istiod-ca-cert\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.328142 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328072 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjdnw\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-kube-api-access-kjdnw\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.328387 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328148 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-data\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.328387 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328180 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-certs\") pod \"a3bae16f-721e-4987-89b0-a134218048bd\" (UID: \"a3bae16f-721e-4987-89b0-a134218048bd\") " Jul 14 01:47:23.328387 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328290 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:47:23.328535 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328501 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:47:23.328535 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328520 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-socket\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:23.328645 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328538 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:47:23.328645 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.328531 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3bae16f-721e-4987-89b0-a134218048bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 01:47:23.329468 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.329439 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:47:23.330397 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.330377 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:47:23.330482 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.330406 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-kube-api-access-kjdnw" (OuterVolumeSpecName: "kube-api-access-kjdnw") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "kube-api-access-kjdnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 01:47:23.330599 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.330575 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 01:47:23.330599 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.330590 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3bae16f-721e-4987-89b0-a134218048bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3bae16f-721e-4987-89b0-a134218048bd" (UID: "a3bae16f-721e-4987-89b0-a134218048bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 14 01:47:23.429279 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.429235 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3bae16f-721e-4987-89b0-a134218048bd-istio-podinfo\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:23.429279 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.429273 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3bae16f-721e-4987-89b0-a134218048bd-istiod-ca-cert\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:23.429279 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.429283 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjdnw\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-kube-api-access-kjdnw\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:23.429520 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.429291 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-data\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:23.429520 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.429301 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-workload-certs\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:23.429520 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.429308 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-istio-envoy\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:23.429520 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.429315 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3bae16f-721e-4987-89b0-a134218048bd-credential-socket\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:23.429520 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:23.429322 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bae16f-721e-4987-89b0-a134218048bd-istio-token\") on node \"ip-10-0-131-57.ec2.internal\" DevicePath \"\"" Jul 14 01:47:24.114987 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.114954 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5th96_103e1ac5-8393-4298-b7c7-ac52a34106dc/manager/0.log" Jul 14 01:47:24.209977 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.209944 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" Jul 14 01:47:24.209977 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.209968 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc" event={"ID":"a3bae16f-721e-4987-89b0-a134218048bd","Type":"ContainerDied","Data":"9db1423d27205360b9976246b4dab8252990a240fa9cb8d3c6162d15d9b038c7"} Jul 14 01:47:24.210519 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.210035 2570 scope.go:117] "RemoveContainer" containerID="2c1decc7aeb676e71c995d3b6074878654333d1de9b4923517759de03a5764b5" Jul 14 01:47:24.231199 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.231166 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc"] Jul 14 01:47:24.236665 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.236643 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a21fee-openshift-default-79567ffb99-tb7xc"] Jul 14 01:47:24.251852 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.251831 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jjjz6_fca4c2f0-a91c-4606-b367-c7a5ca3106eb/manager/0.log" Jul 14 01:47:24.390584 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.390496 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7864cdfb78-74dcc_f38d2bca-19b6-454f-a4b5-d563b5a378bd/manager/0.log" Jul 14 01:47:24.666996 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:24.666965 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3bae16f-721e-4987-89b0-a134218048bd" path="/var/lib/kubelet/pods/a3bae16f-721e-4987-89b0-a134218048bd/volumes" Jul 14 01:47:25.067629 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:25.067551 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-554b6949c8-dpsnp_e9360a64-0d6b-4a6b-aae1-100e1a2d8877/copy-manifests/0.log" Jul 14 01:47:25.073890 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:25.073868 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-554b6949c8-dpsnp_e9360a64-0d6b-4a6b-aae1-100e1a2d8877/manager/0.log" Jul 14 01:47:25.480677 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:25.480644 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-54d67896fb-7m4f9_044b0514-af04-44d2-8b3c-adb84733e39b/maas-api/0.log" Jul 14 01:47:27.466034 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:27.465998 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-wrpxm_02f9fc3b-ca0c-4d7f-bc20-07fb15ed29bf/postgres/0.log" Jul 14 01:47:28.351604 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.351576 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6_3de2ac91-9553-4478-82a7-cfe066f2ccb9/util/0.log" Jul 14 01:47:28.357581 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.357557 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6_3de2ac91-9553-4478-82a7-cfe066f2ccb9/pull/0.log" Jul 14 01:47:28.363126 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.363111 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6_3de2ac91-9553-4478-82a7-cfe066f2ccb9/extract/0.log" Jul 14 01:47:28.489977 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.489949 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx_b1912e55-3f7e-48e6-928e-1bf11a4630fc/util/0.log" Jul 14 01:47:28.495802 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.495782 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx_b1912e55-3f7e-48e6-928e-1bf11a4630fc/pull/0.log" Jul 14 01:47:28.501451 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.501422 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx_b1912e55-3f7e-48e6-928e-1bf11a4630fc/extract/0.log" Jul 14 01:47:28.627297 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.627221 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq_ca2e72ba-9f10-48fc-acb5-f5495a4edd8a/pull/0.log" Jul 14 01:47:28.634068 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.634030 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq_ca2e72ba-9f10-48fc-acb5-f5495a4edd8a/extract/0.log" Jul 14 01:47:28.640590 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.640571 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq_ca2e72ba-9f10-48fc-acb5-f5495a4edd8a/util/0.log" Jul 14 01:47:28.767754 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.767724 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw_61106380-5fde-48e4-a4ca-b2a597642e38/extract/0.log" Jul 14 01:47:28.773899 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.773877 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw_61106380-5fde-48e4-a4ca-b2a597642e38/util/0.log" Jul 14 01:47:28.780194 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.780157 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw_61106380-5fde-48e4-a4ca-b2a597642e38/pull/0.log" Jul 14 01:47:28.928284 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:28.928252 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-579bd69b44-2pvn2_8e997440-f92a-4e59-9425-6ae163f4e5bc/authorino/0.log" Jul 14 01:47:29.185445 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:29.185373 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hrdxg_0446cde6-acf6-4c19-a867-d9c723825ce1/manager/0.log" Jul 14 01:47:29.325165 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:29.325141 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pstxb_4141c1e0-a0c0-4574-989f-f577f6403603/kuadrant-console-plugin/0.log" Jul 14 01:47:29.447903 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:29.447831 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bnzx5_11a48606-bc0c-4e53-b3b9-7cbb6f6444e6/registry-server/0.log" Jul 14 01:47:30.748363 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:30.748338 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b67qf_a7ce7b50-7732-4475-8577-d986d4612aee/istio-proxy/1.log" Jul 14 01:47:30.868471 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:30.868443 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jdztw_e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3/payload-pre-processing/0.log" Jul 14 01:47:30.999995 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:30.999888 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-lmf6f_7f5dda5f-7ac0-4093-90b4-8471dcedde05/payload-processing/0.log" Jul 14 01:47:31.116959 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:31.116902 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8fbcfbfcd-rwqtd_6d2d685e-55ee-4bf4-8bf4-eebecf331634/router/0.log" Jul 14 01:47:31.517218 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:31.517192 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wkv5f_a7fd67dd-0d40-42e7-b35d-30d0484f3bc4/main/0.log" Jul 14 01:47:31.647074 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:31.647050 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-rqcqf_e0f5eb57-d59d-453c-b4ec-d0160c2a3562/main/0.log" Jul 14 01:47:31.903469 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:31.903398 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhwdgz_11854795-537a-4d09-a661-c3a67af5eb20/main/0.log" Jul 14 01:47:36.333335 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:36.333302 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:36.392662 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:36.392632 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:39.007141 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:39.007110 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-22rf5_59c02ce8-6473-4e18-a8d1-f762e45ea446/global-pull-secret-syncer/0.log" Jul 14 01:47:39.120240 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:39.120205 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" Jul 14 01:47:39.195592 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:39.195561 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-57.ec2.internal_d13832b4e3d1bf8ab5549fca691d02f5/haproxy/0.log" Jul 14 01:47:40.255844 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:40.255812 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5jpw_dcf71f03-db11-4a35-895b-f41d25366613/konnectivity-agent/0.log" limit=1024 Jul 14 01:47:43.260801 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.260770 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6_3de2ac91-9553-4478-82a7-cfe066f2ccb9/extract/0.log" Jul 14 01:47:43.285043 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.285022 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6_3de2ac91-9553-4478-82a7-cfe066f2ccb9/util/0.log" Jul 14 01:47:43.305527 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.305499 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bkhv6_3de2ac91-9553-4478-82a7-cfe066f2ccb9/pull/0.log" Jul 14 01:47:43.336321 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.336291 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx_b1912e55-3f7e-48e6-928e-1bf11a4630fc/extract/0.log" Jul 14 01:47:43.358797 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.358772 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx_b1912e55-3f7e-48e6-928e-1bf11a4630fc/util/0.log" Jul 14 01:47:43.384048 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.384024 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wgqfx_b1912e55-3f7e-48e6-928e-1bf11a4630fc/pull/0.log" Jul 14 01:47:43.412495 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.412451 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq_ca2e72ba-9f10-48fc-acb5-f5495a4edd8a/extract/0.log" Jul 14 01:47:43.433207 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.433185 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq_ca2e72ba-9f10-48fc-acb5-f5495a4edd8a/util/0.log" Jul 14 01:47:43.457010 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.456983 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739j6hq_ca2e72ba-9f10-48fc-acb5-f5495a4edd8a/pull/0.log" Jul 14 01:47:43.492764 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.492742 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw_61106380-5fde-48e4-a4ca-b2a597642e38/extract/0.log" Jul 14 01:47:43.514141 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.514085 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw_61106380-5fde-48e4-a4ca-b2a597642e38/util/0.log" Jul 14 01:47:43.537039 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.537014 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19jqhw_61106380-5fde-48e4-a4ca-b2a597642e38/pull/0.log" Jul 14 01:47:43.832861 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.832773 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-579bd69b44-2pvn2_8e997440-f92a-4e59-9425-6ae163f4e5bc/authorino/0.log" Jul 14 01:47:43.882860 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.882833 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hrdxg_0446cde6-acf6-4c19-a867-d9c723825ce1/manager/0.log" Jul 14 01:47:43.908400 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.908374 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pstxb_4141c1e0-a0c0-4574-989f-f577f6403603/kuadrant-console-plugin/0.log" Jul 14 01:47:43.952277 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:43.952249 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bnzx5_11a48606-bc0c-4e53-b3b9-7cbb6f6444e6/registry-server/0.log" Jul 14 01:47:46.069670 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:46.069641 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-dz8tt_768f3d5e-e7d7-4b02-90b2-9e2afd19aa79/cluster-monitoring-operator/0.log" Jul 14 01:47:46.419656 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:46.419615 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tn7t4_573f36fc-1962-4bd3-b123-517295f8e312/node-exporter/0.log" Jul 14 01:47:46.444989 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:46.444960 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tn7t4_573f36fc-1962-4bd3-b123-517295f8e312/kube-rbac-proxy/0.log" Jul 14 01:47:46.470994 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:46.470966 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tn7t4_573f36fc-1962-4bd3-b123-517295f8e312/init-textfile/0.log" Jul 14 01:47:46.790083 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:46.790048 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-j8n9g_7f6c6d1f-d87b-4dda-8455-52b2882f5838/prometheus-operator-admission-webhook/0.log" Jul 14 01:47:46.826625 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:46.826583 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f4d4c5bf-ln6x4_5660a8a6-86f5-4eb1-853c-8f471ebefe1a/telemeter-client/0.log" Jul 14 01:47:46.848043 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:46.848017 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f4d4c5bf-ln6x4_5660a8a6-86f5-4eb1-853c-8f471ebefe1a/reload/0.log" Jul 14 01:47:46.867587 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:46.867568 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f4d4c5bf-ln6x4_5660a8a6-86f5-4eb1-853c-8f471ebefe1a/kube-rbac-proxy/0.log" Jul 14 01:47:48.539954 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:48.539910 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-5g8st_1d7d8424-4118-4a20-877a-8f109a1328ce/networking-console-plugin/0.log" Jul 14 01:47:49.669473 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.669436 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg"] Jul 14 01:47:49.669892 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.669815 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" Jul 14 01:47:49.669892 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.669826 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" Jul 14 01:47:49.669892 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.669843 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" Jul 14 01:47:49.669892 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.669848 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" Jul 14 01:47:49.670107 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.669909 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" Jul 14 01:47:49.670107 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.669935 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3bae16f-721e-4987-89b0-a134218048bd" containerName="istio-proxy" Jul 14 01:47:49.674484 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.674463 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.677071 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.677050 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lrhh6\"/\"kube-root-ca.crt\"" Jul 14 01:47:49.678136 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.678115 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lrhh6\"/\"default-dockercfg-cbk22\"" Jul 14 01:47:49.678261 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.678134 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lrhh6\"/\"openshift-service-ca.crt\"" Jul 14 01:47:49.682203 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.682127 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg"] Jul 14 01:47:49.683493 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.683468 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-749685dd64-4pmkb_1e2c998a-a418-4778-8859-f2b3578c129a/console/0.log" Jul 14 01:47:49.729319 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.729286 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-c2j9q_afb48f9a-79b4-4ac8-90af-0acfd5459fc0/download-server/0.log" Jul 14 01:47:49.750636 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.750607 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-lib-modules\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.750785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.750645 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-proc\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.750785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.750670 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-sys\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.750785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.750707 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-podres\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.750785 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.750753 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjvbq\" (UniqueName: \"kubernetes.io/projected/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-kube-api-access-sjvbq\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.851745 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.851712 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-sys\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.851745 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.851748 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-podres\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.851978 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.851778 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjvbq\" (UniqueName: \"kubernetes.io/projected/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-kube-api-access-sjvbq\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.851978 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.851842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-lib-modules\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.851978 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.851857 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-sys\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.851978 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.851893 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-proc\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.851978 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.851899 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-podres\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.852132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.851982 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-proc\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.852132 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.852000 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-lib-modules\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.859329 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.859305 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjvbq\" (UniqueName: \"kubernetes.io/projected/ebdeb42e-78e2-42b2-9205-eb82490e5ac1-kube-api-access-sjvbq\") pod \"perf-node-gather-daemonset-pqfjg\" (UID: \"ebdeb42e-78e2-42b2-9205-eb82490e5ac1\") " pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:49.986630 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:49.986547 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:50.121963 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:50.121933 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg"] Jul 14 01:47:50.124065 ip-10-0-131-57 kubenswrapper[2570]: W0714 01:47:50.124036 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podebdeb42e_78e2_42b2_9205_eb82490e5ac1.slice/crio-92ce80eea1d17dbc0322e5515151c73bd4366e06ab912d3f0cfc8bf6ea5f358d WatchSource:0}: Error finding container 92ce80eea1d17dbc0322e5515151c73bd4366e06ab912d3f0cfc8bf6ea5f358d: Status 404 returned error can't find the container with id 92ce80eea1d17dbc0322e5515151c73bd4366e06ab912d3f0cfc8bf6ea5f358d Jul 14 01:47:50.346479 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:50.346383 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" event={"ID":"ebdeb42e-78e2-42b2-9205-eb82490e5ac1","Type":"ContainerStarted","Data":"619569d389f0006b30dd1b842a78ed1e735b531d7e37123744dc00a2c8c18573"} Jul 14 01:47:50.346479 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:50.346473 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" event={"ID":"ebdeb42e-78e2-42b2-9205-eb82490e5ac1","Type":"ContainerStarted","Data":"92ce80eea1d17dbc0322e5515151c73bd4366e06ab912d3f0cfc8bf6ea5f358d"} Jul 14 01:47:50.346678 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:50.346613 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:50.362592 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:50.362544 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" podStartSLOduration=1.36253014 podStartE2EDuration="1.36253014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 01:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 01:47:50.360368567 +0000 UTC m=+2918.230803759" watchObservedRunningTime="2026-07-14 01:47:50.36253014 +0000 UTC m=+2918.232965308" Jul 14 01:47:51.384882 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:51.384845 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z2s8x_c771e3b9-fdcf-4ee3-91b1-3bb92e487c71/dns/0.log" Jul 14 01:47:51.409508 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:51.409487 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z2s8x_c771e3b9-fdcf-4ee3-91b1-3bb92e487c71/kube-rbac-proxy/0.log" Jul 14 01:47:51.519965 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:51.519903 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stvd5_153c1406-f910-420b-b32b-0e191ae821b8/dns-node-resolver/0.log" Jul 14 01:47:52.061591 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:52.061557 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tsm4n_3821f29d-fce5-49ab-90ab-3cdd607117f8/node-ca/0.log" Jul 14 01:47:53.136526 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:53.136495 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b67qf_a7ce7b50-7732-4475-8577-d986d4612aee/istio-proxy/0.log" Jul 14 01:47:53.163126 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:53.163095 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b67qf_a7ce7b50-7732-4475-8577-d986d4612aee/istio-proxy/1.log" Jul 14 01:47:53.191010 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:53.190980 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jdztw_e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3/payload-pre-processing/0.log" Jul 14 01:47:53.217173 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:53.217144 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-lmf6f_7f5dda5f-7ac0-4093-90b4-8471dcedde05/payload-processing/0.log" Jul 14 01:47:53.237381 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:53.237353 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8fbcfbfcd-rwqtd_6d2d685e-55ee-4bf4-8bf4-eebecf331634/router/0.log" Jul 14 01:47:53.896198 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:53.896169 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2d26n_a77de954-e2b0-4129-b2c7-2f8ea2dfdbcc/serve-healthcheck-canary/0.log" Jul 14 01:47:54.535654 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:54.535625 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stwbb_c66cfe50-96d7-4ba5-8704-d21a5a02fa9a/kube-rbac-proxy/0.log" Jul 14 01:47:54.556200 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:54.556179 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stwbb_c66cfe50-96d7-4ba5-8704-d21a5a02fa9a/exporter/0.log" Jul 14 01:47:54.575674 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:54.575653 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stwbb_c66cfe50-96d7-4ba5-8704-d21a5a02fa9a/extractor/0.log" Jul 14 01:47:56.364811 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:56.364783 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lrhh6/perf-node-gather-daemonset-pqfjg" Jul 14 01:47:56.575056 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:56.575024 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5th96_103e1ac5-8393-4298-b7c7-ac52a34106dc/manager/0.log" Jul 14 01:47:56.707095 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:56.707059 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jjjz6_fca4c2f0-a91c-4606-b367-c7a5ca3106eb/manager/0.log" Jul 14 01:47:56.797822 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:56.797789 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7864cdfb78-74dcc_f38d2bca-19b6-454f-a4b5-d563b5a378bd/manager/0.log" Jul 14 01:47:57.075458 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:57.075379 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-554b6949c8-dpsnp_e9360a64-0d6b-4a6b-aae1-100e1a2d8877/manager/0.log" Jul 14 01:47:57.095091 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:57.095066 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-554b6949c8-dpsnp_e9360a64-0d6b-4a6b-aae1-100e1a2d8877/copy-manifests/0.log" Jul 14 01:47:58.308994 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:58.308962 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cb746fd84-bccnf_9c4a7dfc-c3b6-49fc-a185-c8e4b5a29812/manager/0.log" Jul 14 01:47:59.696552 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:59.696469 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b67qf_a7ce7b50-7732-4475-8577-d986d4612aee/istio-proxy/0.log" Jul 14 01:47:59.726198 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:59.726175 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b67qf_a7ce7b50-7732-4475-8577-d986d4612aee/istio-proxy/1.log" Jul 14 01:47:59.744328 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:59.744301 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jdztw_e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3/payload-pre-processing/0.log" Jul 14 01:47:59.763114 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:59.763083 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-lmf6f_7f5dda5f-7ac0-4093-90b4-8471dcedde05/payload-processing/0.log" Jul 14 01:47:59.774749 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:47:59.774724 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8fbcfbfcd-rwqtd_6d2d685e-55ee-4bf4-8bf4-eebecf331634/router/0.log" Jul 14 01:48:01.118203 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:01.118176 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b67qf_a7ce7b50-7732-4475-8577-d986d4612aee/istio-proxy/0.log" Jul 14 01:48:01.146743 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:01.146663 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b67qf_a7ce7b50-7732-4475-8577-d986d4612aee/istio-proxy/1.log" Jul 14 01:48:01.167869 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:01.167840 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jdztw_e26dc2ba-9cef-4c3e-9951-f8e25d6b50d3/payload-pre-processing/0.log" Jul 14 01:48:01.189305 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:01.189281 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-lmf6f_7f5dda5f-7ac0-4093-90b4-8471dcedde05/payload-processing/0.log" Jul 14 01:48:01.203420 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:01.203389 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8fbcfbfcd-rwqtd_6d2d685e-55ee-4bf4-8bf4-eebecf331634/router/0.log" Jul 14 01:48:03.470724 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:03.470695 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pb29x_d394b87a-9aa0-4f72-9db6-346ee5ff912e/migrator/0.log" Jul 14 01:48:03.495933 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:03.495877 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pb29x_d394b87a-9aa0-4f72-9db6-346ee5ff912e/graceful-termination/0.log" Jul 14 01:48:05.060473 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.060447 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v88rj_b2bd9248-47c5-4260-8895-8ae20844bf63/kube-multus-additional-cni-plugins/0.log" Jul 14 01:48:05.081214 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.081190 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v88rj_b2bd9248-47c5-4260-8895-8ae20844bf63/egress-router-binary-copy/0.log" Jul 14 01:48:05.102847 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.102712 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v88rj_b2bd9248-47c5-4260-8895-8ae20844bf63/cni-plugins/0.log" Jul 14 01:48:05.122044 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.122025 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v88rj_b2bd9248-47c5-4260-8895-8ae20844bf63/bond-cni-plugin/0.log" Jul 14 01:48:05.140677 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.140658 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v88rj_b2bd9248-47c5-4260-8895-8ae20844bf63/routeoverride-cni/0.log" Jul 14 01:48:05.158313 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.158293 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v88rj_b2bd9248-47c5-4260-8895-8ae20844bf63/whereabouts-cni-bincopy/0.log" Jul 14 01:48:05.176689 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.176662 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v88rj_b2bd9248-47c5-4260-8895-8ae20844bf63/whereabouts-cni/0.log" Jul 14 01:48:05.244790 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.244764 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rg4j7_911d28d9-c271-419a-85e2-a9fa7e45268c/kube-multus/0.log" Jul 14 01:48:05.292245 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.292214 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5vn5k_1eb58e6e-5b22-467f-8725-65881c70b0b9/network-metrics-daemon/0.log" Jul 14 01:48:05.309033 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:05.309011 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5vn5k_1eb58e6e-5b22-467f-8725-65881c70b0b9/kube-rbac-proxy/0.log" Jul 14 01:48:06.592991 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:06.592962 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvd8l_f5e04682-83df-4db2-987e-5c254abb5fee/ovn-controller/0.log" Jul 14 01:48:06.611980 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:06.611951 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvd8l_f5e04682-83df-4db2-987e-5c254abb5fee/ovn-acl-logging/0.log" Jul 14 01:48:06.633111 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:06.633082 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvd8l_f5e04682-83df-4db2-987e-5c254abb5fee/kube-rbac-proxy-node/0.log" Jul 14 01:48:06.652291 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:06.652264 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvd8l_f5e04682-83df-4db2-987e-5c254abb5fee/kube-rbac-proxy-ovn-metrics/0.log" Jul 14 01:48:06.671229 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:06.671204 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvd8l_f5e04682-83df-4db2-987e-5c254abb5fee/northd/0.log" Jul 14 01:48:06.691169 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:06.691148 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvd8l_f5e04682-83df-4db2-987e-5c254abb5fee/nbdb/0.log" Jul 14 01:48:06.720902 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:06.720871 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvd8l_f5e04682-83df-4db2-987e-5c254abb5fee/sbdb/0.log" Jul 14 01:48:06.769569 ip-10-0-131-57 kubenswrapper[2570]: I0714 01:48:06.769544 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tvd8l_f5e04682-83df-4db2-987e-5c254abb5fee/ovnkube-controller/0.log"